Technical Report # 1319 


The Development and Scaling of the easyCBM 
CCSS Elementary Mathematics Measures: 
Grade 5 


Jessica L. Saven 
P. Shawn Irvin 
Bitnara Jasmine Park 
Julie Alonzo 
Daniel Anderson 
Gerald Tindal 


University of Oregon 



PiBRT 

behavioral research & teaching 


Published by 

Behavioral Research and Teaching 

University of Oregon *175 Education 

5262 University of Oregon • Eugene, OR 97403-5262 

Phone: 541-346-3535 • Fax: 541-346-5689 

http://brt.uoregon.edu 


Note: Funds for this data set used to generate this report come from a federal grant awarded to the UO from the Institute of 
Education Sciences, U.S. Department of Education: Developing Middle School Mathematics Progress Monitoring 
Measures (R324A100026 funded from June 2010 - June 2014). 

Copyright© 2012. Behavioral Research andTeaching. All rights reserved. This publication, or parts 
thereof, may not be used or reproduced in any manner without written permission. 

The University of Oregon is committed to the policy that all persons shall have equal access to its 
programs, facilities, and employment without regard to race, color, creed, religion, national 
origin, sex, age, marital status, disability, public assistance status, veteran status, or sexual 
orientation. This document is available in alternative formats upon request. 


Abstract 


The results of formative assessments are regularly used to infonn important instructional 
decisions (e.g., targeted intervention) within a response to intervention (RTI) system of 
teaching and learning. The validity of such instructional decision-making depends, in 
part, on the alignment between formative measures and the academic content standards 
on which classroom instruction is based, as well as the technical adequacy of the 
measures used in RTI applications. In the following technical report, we describe the 
development and scaling of the easyCBM Common Core State Standards elementary 
school mathematics measures for use within an RTI framework. Within a given grade, 
math items from two distinct item pools were calibrated to a common horizontal scale 
using a 1 -parameter Rasch analysis. The results of the scaling were then used to 
construct 13 alternate forms designed to be of comparable difficulty - 3 forms designated 
for seasonal benchmark screening and 10 designated for progress monitoring. Prior and 
subsequent grade-level math items were added to the benchmark test fonns as a basis for 
constructing a common vertical scale in the future. Evidence of technical adequacy is 
reported in appendices by both test form and by the full bank of CCSS items piloted and 


scaled. 
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The Development and Scaling of the easyCBM CCSS 
Elementary Mathematics Measures: Grade 5 

The mathematics measures from the easyCBM interim-formative assessment system for 
grades K-8 were designed for use in a Response to Intervention (RTI) framework (Alonzo, Lai, 

& Tindal, 2009a, 2009b, 2009c; Alonzo & Tindal, 2009a, 2009b; Lai, Alonzo, & Tindal, 2009), 
which can be used both for whole-school improvement (Shores & Chester, 2009) as well as to 
identify students in need of special education services (VanDerHeyden, Witt, & Gilbertson, 
2007). A functional RTI system hinges on the use of measures that are aligned with adopted 
content standards, so that instructional decisions are based on results from student assessment 
that reflect what they are learning in their classrooms (Fuchs & Fuchs, 2006). The easyCBM 
measures were originally developed to align with the National Council of Teachers of 
Mathematics (NCTM) Focal Points Standards (Nese et al., 2010), that were adopted by many 
states as the basis for teaching mathematics. 

In 2010 the Common Core State Standards (CCSS) were released as a guide for preparing 
students for college and careers (National Governors Association Center for Best Practices & 
Council of Chief State School Officers, 2010). The subsequent endorsement of the standards by 
the U.S. Department of Education (2010) and their recommendation of creating assessments that 
provide improved measurement of student progress toward skills outlined in the CCSS, 
coincided with a majority of states adopting the CCSS as the basis for student instruction and 
assessment (National Governors Association Center for Best Practices & Council of Chief State 
School Officers, 2010). Similarly, developers of curriculum-based measurements (CBM), long 
used to monitor growth toward general outcomes and skill mastery through multiple short, 
technically adequate, and sufficiently equivalent test forms (e.g., Deno, 2003; Tindal, 2013), also 
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began work to align their measures with the CCSS. A study of existing easyCBM math 
measures to determine the extent to which they were in alignment with the CCSS followed in 
2012 (Irvin, Park, Alonzo, & Tindal, 2012a, 2012b; Park, Irvin, Alonzo, & Tindal, 2012). 

The 2012 alignment studies found reasonable alignment between the easyCBM 
mathematics measures and the CCSS for grades K-5; however, gaps across specific grade-level 
domains and standards remained. Identification of these gaps provided the basis for developing 
new technically adequate K-5 CCSS-aligned math items and test forms for use in the easyCBM 
interim-formative assessment system and in RTI application - the development, piloting and 
scaling of which are discussed in this technical report. 

Methods 

In developing the easyCBM CCSS mathematics measures, we focused on alignment with 
the CCSS and accessibility for diverse student populations with a range of achievement levels. 
The following section outlines the process we used to develop math items and subsequently 
assemble benchmarking and progress monitoring test forms for use in RTI frameworks of 
teaching and learning. 

Item Development 

The K-5 CCSS in mathematics are comprised of four (Grades 1 and 2) or five (Grades K, 
3-5) domains that are further divided into 21-28 individual standards. Though some grade- 
level standards were further divided into more granular sub-standards, such sub-standards were 
treated as part of the larger standard; thus, an item written to a given sub-standard was 
considered as being written to its parent standard. A total of 3,000 new CCSS math items were 
written, 500 items in each of grades K-5, based on the gaps in CCSS coverage identified through 
previous research (Irvin et ah, 2012b; Park et ah, 2012). 
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Item writing and review training. Two groups were recruited to develop CCSS math 
items based on their experience and expertise in mathematics teaching and learning. Four item 
writers for each of three grade bands: K-l, 2-3 and 4-5, and six item reviewers, one for each of 
grades K-5, were recruited. One of the original four item writers voluntarily dropped from the 
study, and thus, two item writers split their duties within the grade 4-5 band. Writers and 
reviewers were recruited to develop and review math items appropriate to their expertise. On 
average, item writers and reviewers had about 14 years of teaching experience in math education, 
ranging from 3-32 years. Each item writer/reviewer held a Bachelor’s degree and 16 of the 18 
(including all reviewers) also held a Master’s degree. Item writers were recruited in a manner to 
balance expertise across general and special education classrooms. All item reviewers had 
demonstrated expertise in both general and special education and also worked in district 
leadership positions, for example, as math coaches or curriculum developers. 

In December 2012, item writers and reviewers attended one of four mandatory 2.5-hour 
training webinars, led by the lead project researcher, who was onsite at the offices of Behavioral 
Research and Teaching (BRT) at the University of Oregon. The webinar training consisted of 
two main sections. An initial study overview reviewed the context of the research study and 
described item writing and reviewing duties in detail. Specifically, for each new CCSS math 
item, item writers and reviewers were required to write a stem (question or prompt) and three 
answer choices (one correct and two distractors) that were similar in length and complexity level. 
When constructing distractor options, writers and reviewers were informed that they should be 
relevant to the math skills required by the problem - ideally targeting a range of plausible student 
mistakes. Item writers and reviewers could also include graphics for the stem and/or answer 
options when relevant to the problem. When graphics were called for, item writers provided a 
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rough sketch and/or description of the graphic, and a graphic artist later created digital images 
for each of the graphics. The second training section focused on techniques around effective and 
appropriate item writing, and included principles of quality item/test development as outlined by 
Haladyna (2004) and Downing (2006a, 2006b), and those around Universal Design for 
Assessment (e.g., precise construct targets, accessibility to diverse populations, lack of bias) as 
outlined by Thompson, Johnstone, and Thurlow (2002). 

Throughout each section of the webinar training, item writers and reviewers were 
required to collaboratively participate in activities designed to ensure deep understanding of 
study roles, including observation and discussion of math items. In other words, a variety of 
math items were shown to writers and reviewers, followed by a discussion of why they met or 
did not meet the principles of quality item/test development or why they were (or were not) 
aligned to the CCSS. The lead researcher, writer and reviewers brainstormed and discussed 
specific ways in which items could be altered to meet item design principles or better align to an 
identified CCSS in instances where non-examples were shown. Particular attention was paid to 
crafting effective distractor options and graphics options associated with math items. Effective 
multiple-choice items typically have one distractor option that is “closer” to the correct response 
and one distractor that is “further” from the correct response (Haladyna, 2004) - the third 
response option being the correct answer for a given math item. Graphics, whether for the stem 
and/or answer options, are included for a math item only as necessary to meet a targeted content 
standard and to critically consider and solve a given math problem. This was the manner in 
which writers were asked to write answer options and include graphics for this study. At the end 
of the training webinar, the item writing process was again described in detail, including the 
specific roles of item writers and reviewers, in connection with expected timelines and 
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deliverables. The PowerPoint Slides used in the webinar training were adapted from those used 
in Anderson, Irvin, Patarapichayatham, Alonzo, and Tindal (2012), and are shown in Appendix 
A. 

Item writing. In general, item writers and reviewers worked concurrently to write, edit 
and revise 500 new CCSS-aligned math items (four item sets) in each of grades K-5. 

Specifically, item writers wrote 250 new math items: 125 items (in each of two items sets) for 
each grade of their assigned grade band (i.e., K-l, 2-3 or 4-5). For example, “item writer 1” was 
assigned to write 125 math items in each of Grades K and 1 to align with the targeted CCSS. 
Table 1 displays the math item writing plan for fifth grade by item set and CCSS. Item writers 
iteratively wrote and submitted items to the lead researcher (and item reviewers) in small batches 
between January and March 2013, typically submitting between 10-25 items at a time for further 
review and editing. Throughout the iterative item writing process, item writers and reviewers 
were in contact with the lead researcher by email and phone to hone their skills, and thus, the 
quality and consistency of math items produced. 

Item review. We conducted three separate stages of item review prior to item scaling: 

(a) review by contracted item reviewers, (b) an internal review by University of Oregon 
education researchers at BRT, and (c) an external review by individuals without prior connection 
to the items. The first review took place concurrently with item writing, in which a single item 
reviewer was assigned to review all 500 math items for a given grade level (K-5). Prior to 
contracted item reviewers receiving items, the lead researcher briefly reviewed the small batches 
of submitted items for completeness, accuracy and features consistent with effective item writing 
discussed during the webinar training (e.g., effective items, Universal Design for Assessment), 
subsequently passing them to the assigned reviewer concurrent with the item writing process. 
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Item reviewers then carefully reviewed and edited each grade level math item for completeness, 
accuracy and features consistent with effective item writing discussed during the webinar 
training - this included editing for distractor and graphical option appropriateness. Further, 
because item reviewers had access to 125 items from each of four item writers, they also edited 
math items that were too similar (across item writers) while attempting to maintain the content 
and skill intention of the item writers. 

For the second stage of item review, all math items (subsequent to graphics development 
- see below) were uploaded to a secure website to be reviewed as students would see them in the 
online easyCBM formative assessment environment. Math items were then assigned and 
reviewed internally by a group of university education researchers from BRT. Reviewers 
included university faculty and doctoral students in education research with experience in test 
and item development. During the internal review, reviewers again analyzed and edited items 
for mathematical correctness while also looking for possible bias or features inconsistent with 
Universal Design for Assessment principles. Additionally, internal reviewers ensured that all 
items were formatted in a consistent manner. All reviewers during this stage had been trained 
and taken part in a previous internal review of middle school math items (Anderson et ah, 2012), 
and thus, were deemed competent to serve on the internal review team in the current study. A 
team of external reviewers without prior connection to the item development conducted the final 
item review. We contracted with three individuals who did not have item writing or mathematics 
teaching/assessment experience to review math items (on the secure website) for mathematical 
accuracy, consistent formatting, and audio file accuracy (see below). Our intention behind this 
manner of external review was to have a “fresh look” at the math items apart from the item 
writers, various reviewers and the lead researcher, all of whom had had considerable prior 
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contact with the math items. 

Graphics and audio development. We contracted with a professional graphics artist to 
produce images for all math items. The artist used Adobe Illustrator to develop simple and clear 
line drawings without shading consistent with Universal Design for Assessment 
recommendations (Thompson et ah, 2002). The artist produced graphics only when explicitly 
requested by the item writer/reviewer - a development option for the stem and/or the answer 
options for a given math item. The artist produced each item graphic based on either a detailed 
written description or a hand-drawn/electronic version (e.g., a jpeg found on the Internet) 
provided by an item writer/reviewer. Graphic images were iteratively edited based on feedback 
from the three review stages. We also contracted an individual to produce audio recordings of 
written text in all math items. In the easyCBM online assessment system, students have the 
option to click on a speaker button next to the stem and/or distractor answer, which results in 
having the text-based portions of the item “read-aloud” to them. Audio recordings were 
reviewed and revised as necessary during the second and third review stages during item 
development. 

Scaling 

We carried out four primary steps during the scaling of the new K-5 CCSS math items: 

(a) developing a piloting plan, (b) selecting anchor items from the existing NCTM-based 
easyCBM and the new CCSS math item pools to create pilot forms, (c) recruiting subjects and 
piloting the items, and (d) calibrating grade-level items to a common scale. 

Piloting plan. For each of grades K-5, we developed a common piloting plan, comprised 
of 15 total pilot forms, to guide pilot form creation. We included 32 total math items in each 
form for grade K-l, and 41 total items for grades 2-5. Of the 32 or 41 items in a given pilot 
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form, we dedicated 5 horizontal anchor items to link to the previous pilot form and 5 horizontal 
anchor items to link to the subsequent pilot form. For example, pilot form 2 had 5 anchor items 
linking to pilot form 1, and 5 anchor items linking to pilot form 3. This meant that there were 22 
unique math items in each of the grade-level pilot forms for grades K-l, and 3 1 for grades 2-5. 
Of the 10 total anchor items within a given pilot form, 5 were selected from the existing 
easyCBM item pool - items originally written to the NCTM Focal Point Standards (Nese et al., 
2010), though deemed aligned to the CCSS in recent alignment studies (Irvin et ah, 2012b; Park 
et ah, 2012), and 5 were selected from the new CCSS-based item pool. For simplicity and 
clarity, these two pools will hereto be referred to as NCTM and CCSS item pools, though it 
should be noted that all items used in this project from both pools had been deemed aligned to 
the CCSS (the full combined CCSS item bank). 

By including horizontal anchors from both item pools, we were able to more than double 
the size of the overall item pool from which we would select items to create the operational 
CCSS test forms by calibrating the two original pools to a common scale. Additionally, this 
saved valuable item writing and review resources. It should be noted that unlike the piloting 
plan used for the easyCBM CCSS middle school math measure development study (see 
Anderson et ah, 2012), vertical (across-grade) anchor items were not included in the K-5 
piloting. Rather, we included prior- and subsequent-grade math items in the operationalized test 
forms for grades 1-5 (and prior-grade items for grade K) in order to calibrate a common scale 
over the 2013-2014 academic year, reasoning far more students would provide item-level 
information for the operationalized items as a basis for future review of technical adequacy of 
items and test forms (see fonn creation, below). The grades 3-5 piloting plan, showing the 
number and placement of horizontal anchor items selected from both the existing NCTM as well 
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as the CCSS item pools, is displayed in Table 2. 

Choosing anchors and creating pilot forms. A team of four researchers (including the 
lead researcher) collaborated to select the anchor items from the NCTM and CCSS pools for 
pilot forms. One of the researchers had a Ph.D. in Educational Measurement and Evaluation, 
and two were doctoral students in the University of Oregon’s Educational Methodology, Policy, 
and Leadership program. The researcher with the Ph.D. and both doctoral students were familiar 
with the math item development and items, as they had worked with the lead researcher during 
item writing and had served on the internal item review team. 

As mentioned earlier, anchor items for the current piloting were selected from two 
different item pools by four researchers. Items selected from the K-5 NCTM pool had been 
previously piloted and scaled (Alonzo et ah, 2009a, 2009b, 2009c; Alonzo & Tindal, 2009a, 
2009b; Lai et ah, 2009), and thus, item-level information was available to guide anchor selection. 
Researchers followed a number of guidelines when selecting anchor items from the NCTM pool. 
Anchor items were selected to balance estimated difficulty across all 1 5 pilot forms (easy, 
medium, hard), while also falling within the acceptable range of mean-square outfit values (0.5 
to 1 .5) recommended for reliable measurement in high-stakes multiple-choice test construction 
(Wright & Linacre, 1994). 

A further constraint for selection of anchor items from the NCTM pool was that they be 
aligned to the CCSS. Based on results from Irvin et al. (2012b) and Park et al. (2012), we cross- 
walked NCTM Focal Point Standards and CCSS that were associated with each other when 
NCTM-written items were deemed aligned to particular CCSS in the alignment studies. In this 
manner, items originally written to the NCTM Focal Point Standards, though not necessarily 
included in the 2012 alignment studies, were deemed aligned to the CCSS and included in the 


easyCBM CCSS Fifth Grade Math Measure Development 


10 


pool from which we selected anchor items in the current study (in addition to those items 
specifically deemed aligned in the earlier studies). Lastly, we attempted to stratify anchor items 
selected from the NCTM pool by CCSS. For instance, in fifth grade there are 5 different CCSS 
domains with a total of 37 unique anchor items needed to populate the 15 pilot forms; thus, 8-9 
items were selected from each CCSS domain in fifth grade and stratified across pilot forms as 
evenly as possible. 

Empirically estimated item-level information was not available for items in the new 
CCSS pool; thus, it was impossible to know the difficulty or mean-square outfit of items in the 
K-5 CCSS pool to guide anchor selection. Therefore, we adopted the same anchor item selection 
process used in our previous easyCBM CCSS middle school math item development study (see 
Anderson et ah, 2012, p. 9 and 22), whereby our team of four researchers worked together to 
select appropriate anchor items for pilot forms based on: (a) an appropriate number of steps 
required to respond to the item (typically 2-3), (b) minimal language requirements outside of that 
needed to solve the math problem, (c) culturally unbiased (e.g., a blend of diverse names, 
avoiding overrepresentation of subject matter unrelated to the targeted math knowledge/skills), 
(d) direct alignment to targeted CCSS, and (e) consistency with principles of Universal Design 
for Assessment. As was the case for anchor items selected from the NCTM pool, those selected 
from the CCSS pool were stratified by CCSS domain in an attempt to balance representation 
within and across each grade-level pilot form. 

After we selected horizontal anchor items, we created 1 5 pilot forms for each of grades 
K-5. For all grades, the first 4 items of each pilot fonn were unique items written to the CCSS as 
part of this study. The next 10 items (items 5-14) of each form were horizontal anchor items. 

We populated items 5-9 with anchor items selected from the NCTM pool, and items 10-14 with 


easyCBM CCSS Fifth Grade Math Measure Development 


11 


anchor items selected from the CCSS pool. For both bands of anchor items (5-9 and 10-14), 
either 2 or 3 items li nk ed to previous or the following pilot forms as shown in Table 2. It should 
be noted that pilot forms 1 and 1 5 shared either 2 or 3 horizontal anchor items between them, 
given they were at the “ends” of the line of forms (i.e., form 15 served as the “previous” form to 
form 1 and vice versa). In keeping with the recommendations of Kolen and Brennan (2004), the 
placement and order of each anchor item were held constant on a given pilot form. Finally, the 
unique items were last: items 15-32 for grades K-l, and 15-41 for grades 2-5. All unique items 
were stratified within and across pilot forms by standard and domain as appropriate and possible 
to balance content representation. 

Participant recruiting and participation. Over the winter and spring of 2013, teachers 
from K-5 classrooms were recruited to participate in the pilot individually and at the district level 
through the easyCBM (http://www.easycbm.com) and BRT websites (http://www.brtproiects.org 
/about /current-research), and through existing research cooperative relationships around the 
country. To protect confidentiality, districts, schools and teachers interested in participating 
were informed in writing that identifying information (e.g., demographics) would not be 
collected on students or teachers, and only information relevant to meeting research partnership 
status would be collected at the school and district levels (e.g., the total number of participating 
students per district or school). At the same time, interested participants were also given general 
details concerning the piloting process, described more specifically below, to make clear the 
study requirements. 

A minimum of 200 student responses per item is desirable to obtain stable and accurate 
item calibrations using the 1 -parameter logistic Rasch model in a concurrent equating design, as 
was used in the current study. To fulfill this minimum response requirement, we needed to 
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recruit 3000 students (15 forms * 200 responses) for each of grades K-5. We were, however, 
constrained by the end of the academic calendar and recruitment resources, and thus, we did not 
meet the minimum desirable response requirements for each form (and item). In total, 7,700 
students and 329 teachers from 140 schools, in 132 districts, across 33 states participated in the 
piloting portion of the study that began on May 15, 2013 and ended on June 15, 2013. The 
following number of students participated in the pilot by grade: 731 (grade K), 1,124 (grade 1), 
1,136 (grade 2), 1,685 (grade 3), 1,499 (grade 4) and 1,525 (grade 5). Final pilot participation 
statistics by grade and fonn are given in Table 3. 

Piloting process. Once they agreed to participate, teachers were given detailed 
instructions on how to access the secure piloting website, how to have their students select the 
appropriate grade level (K-5), and how their students would begin and take the online test. 
Students were instructed to use scrap paper as necessary, but not to use calculators to complete 
any math items. Once students selected their appropriate grade, they were shown a title screen 
that prompted them to begin the test by clicking an onscreen button when ready. Students were 
then immediately administered one of 15 grade-level pilot forms. The administered test form 
was automatically assigned by the piloting website, based on the number of students who had 
completed that form previously. In other words, students were assigned the grade-level pilot 
form with the fewest number of completions across all students in the pilot. Student responses 
(a, b, or c) were automatically recorded in a secure online database based on which response 
option a student selected, with the position in which the three answer options (a, b, or c) were 
displayed on the students’ computer screens randomized each time an item was administered. 
Given that pilot forms were assigned based on the number of times they had been completed and 
that answer options were randomly rotated each time an item was administered, cheating was a 
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limited concern. A screen capture of a fifth grade math item demonstrative of how all items 
displayed on the pilot website (and indeed the K-8 easyCBM formative assessment system) is 
shown in Figure 1. 



Figure 1. Screen capture of math item illustrating online display of math items in the pilot study 
and easyCBM assessment system. 

Item calibration. All math items, including those from the larger and previously- 
existing NCTM pool, were calibrated to the same scale using a 1-parameter logistic (1PL) Rasch 
model in a concurrent equating design using Winsteps 3.6.8 (Linacre, 2009). In the Rasch 
model, a special case of the 1 -parameter logistic model in which the item discrimination 
parameter is constrained to 1.0 and student ability is freely estimated (Linacre, 2008), all item 
and student parameters are estimated simultaneously from a single data file that contains all 
student responses, grades K-5. The concurrent equating design estimates student ability based 
on their responses to items, treating any non-responses as missing. Items are placed on the same 
scale through the inclusion of anchor items across grade level forms, displayed in Table 2. 
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The Rasch model is defined as 


P(X LS 


H e s ,pd = 


exp[(0 s -Pj)] 

1 +exp[(e s -Pi)] 


( 1 ) 


where: 

P = probability, 

Xts = the response of student s to math item i, 

6 S = the estimated ability of student s, and 

fi = the estimated difficulty of math item i (DeMars, 2010). 

We chose the more parsimonious 1PL Rasch model because it appears to fit these data 
well, and also because we had a large final item ba nk of CCSS math items (full CCSS item bank) 
for grades K-5, which we analyzed for functioning and used to construct the operational 
easyCBM test forms. In other words, we had a surplus of items from which to construct test 
forms, enabling us to eliminate those items that did not function well from the full CCSS item 
bank. 


Test form creation. Within each of grades K-5, we constructed 13 alternate test forms 
designed to be of comparable difficulty (3 to be used as seasonal benchmark screening tests and 
10 to be used as progress monitoring tests) to make up the CCSS Math portion of the easyCBM 
formative assessment system. All test forms consisted of items that appeared to function well, 
while counterbalancing CCSS domain representation within and across each grade level form as 
possible. To construct the test forms, we first eliminated all items from the full CCSS item ha nk 
that appeared to not fit the 1PL Rasch model with regard to estimated mean square outfit. 

Wright and Linacre (1994) simulated and analyzed hundreds of datasets, recommending that 
mean square outfit values between 0.5 and 1.5 could be interpreted as productive for 
measurement purposes for multiple-choice test construction, with values >2.0 considered 
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degrading to the measurement system. As an initial step in test form construction, we thus 
eliminated any item from contention that had mean square outfit smaller than 0.49 or greater than 
1.49. 

After eliminating such items, within each grade we sorted the remaining items in 
ascending order by the associated CCSS domain and the estimated difficulty of items (easiest to 
most difficult). Within each grade, there were either 4 (grades 1 and 2) or 5 (grades K, 3-5) 
CCSS domains we attempted to counterbalance within and across test forms. Thus, we 
attempted to select the same number of items from each CCSS domain across the 13 test forms at 
a given grade level, though this was not possible in all instances, as some CCSS domains were 
underrepresented relative to others. To accomplish counterbalancing CCSS domain 
representation while maintaining form comparability, we selected sets of 13 items of roughly 
comparable difficulty. We sought a range of difficulty between these selected item sets, 
including items with “reach” into the easier end of the difficulty spectrum, being cognizant that 
the operational tests would be used to assess diverse student populations, from both the special 
education and general education populations, within an RTI framework. In terms of the layout 
of selected math items within test forms, we clustered items within CCSS domain, and then 
ordered them from easiest to most difficult. We reasoned that construct-irrelevant variance 
would likely be lessened if students were jumping between domains less often, and if the math 
skill requirements of problems “ramped up” from lower- to higher-order within each domain. 

The final step in the test fonn creation process was our selection of horizontal anchor 
items between grade level seasonal benchmarks to allow for within-year growth estimation, and 
vertical anchors between seasonal benchmarks across grades as a basis for constructing a 
developmental scale score after the 2013-2014 academic year. The same team of four 
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researchers who selected anchors during piloting, selected anchor items for the operational test 
forms using the same process and guidelines previously described because they were intimately 
familiar with the math items and the item/test development process. 

We selected horizontal anchor items for each benchmark using a within- grade linking 
design. Within each grade, 5 horizontal anchors were selected to link the fall and winter 
benchmarks, and 5 to link the winter and spring; thus, each fall and spring benchmark test form 
had 5 horizontal anchor items, while the winter test had 10. Horizontal anchor items were 
selected from those items already making up the benchmark tests at that point in the test form 
creation process. At this point, we had constructed 13 test forms designed to be of comparable 
difficulty in each of grades K-5, each test form consisting of 25 (grades K-2) or 30 (grades 3-5) 
math items. 

We then selected vertical anchor items from the constructed test forms, adding 5 (grade 
K) or 10 (grades 1-5) math items to the end of each benchmark test in a manner that li nk ed 
adjacent grade level benchmarks of the same season. For example, we selected 5 first grade 
math items from the fall benchmark to add on to the end of the fall Kindergarten benchmark 
(linking fall grade K to fall grade 1). When a grade was adjacent to two other grades (i.e., grade 
3 is adjacent to both grades 2 and 4), additional vertical anchors were appended to the end of the 
seasonal benchmark test forms. For example, the fifth grade fall benchmark included 5 vertical 
anchor items from the fourth grade fall benchmark and 5 items from the sixth grade fall 
benchmark. Within each test form, adjacent grade-level vertical anchor items were ordered from 
easiest to most difficult based on the estimated difficulty of each item - the same manner in 
which unique and horizontal anchor items were ordered with respect to CCSS domain - and 
were appended to the end of each seasonal benchmark in the order of subsequent and then prior 
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grade, respectively. This pattern of vertical anchor linking prior and adjacent grades continued 
for all seasonal benchmarks for each of grades K-5 (and also grades 6-8, though those results are 
not included in this series of technical reports). Student responses to vertical anchor items over 
the 2013-2014 academic year will serve as the basis for constructing a cross-grade 
developmental scale as we move toward the reporting of a scale score in future years. 

Results 

As a result of item development and test creation efforts described in this study, we 
constructed 13 alternate test forms: 3 designated for seasonal benchmarking and 10 designated 
for progress monitoring, in each of grades K-5. We designed the test forms to be aligned with 
the CCSS in mathematics, to be of comparable difficulty within grade, and to be accessible for 
diverse student populations with a wide range of achievement. We loaded K-5 tests into the 
easyCBM database for use as online formative CCSS math assessments and released them for 
use in fall 2013. 

The results of our analyses are reported separately by grade (K-5), each in its own 
technical report. For fifth grade, each seasonal benchmark consists of 40 total math items, 
including 5 vertical anchor items linked to each of the respective grade 4 and grade 6 
benchmarks. Each progress-monitoring test form consists of 30 unique math items. The item 
difficulties for each of the 13 fifth grade test forms are displayed in Table 4. 

Item Statistics 

We present the results of the 1PL Rasch analysis in ascending order by test form and for 
the full CCSS fifth grade item ha nk in Appendices B and D, respectively. When examining item 
information in these appendices, it is important to highlight two statistics critical to evaluating 
item functioning within the context of Rasch-based test development: the estimated difficulty and 
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indicator of discrimination. The difficulty parameter, in equation 1, represents the estimation 
of how difficult item i is relative to all other items in the analytic sample, with approximate 
possible values ranging from -3 (easiest items) to +3 (most difficult items) in the standardized 
scale - the same scale on which student ability ( 0 S ) is reported (DeMars, 2010). An estimated 
difficulty equal to 0 could then be interpreted as a student with average ability would have an 
equal probability of getting the answer correct as incorrect. Individual item difficulties are 
averaged across forms, representing an average difficulty of each test form as displayed in Table 
4, to evaluate fonn equivalence. The average difficulty across all 13 fifth grade test forms is 
0.254 (range = 0.251 to 0.259), or slightly above average difficulty. 

The second statistic that warrants highlighting is the indicator of item discrimination. As 
noted earlier, the 1PL Rasch analysis constrains the discrimination parameter to 1.0 (DeMars, 
2010; Linacre, 2008). Though discrimination statistics are included for each item in Appendices 
B and D, it is important to distinguish that this item statistic is not a true estimation of item 
discrimination, but rather an rough indicator of item discrimination, approximated during a post- 
hoc calculation by WINSTEPS (Linacre, 2008). Interpretation of discrimination values in 1PL 
Rasch analysis is the same as those freely estimated in, for example, a 2-parameter logistic 
model; though, caution is warranted given they are merely rough indicators in this study. 
Discrimination values >1.2 are considered very high (more productive for measurement 
purposes), while values < 0.5 are considered very low, when item difficulty and student ability 
are estimated in the standardized scale (DeMars, 2010), as is the case in our analysis. 

Distractor Analysis 

We present response option statistics in ascending order by test form and for the full 
CCSS fifth grade item ha nk in Appendices C and E, respectively. Interpretation of statistics 
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within these appendices is similar to item level interpretation, but is presented for each of the 
three response options. We coded the correct response option as A for all items, while the * 
represents missing data (those students included in the analytic sample who did not respond to 
the given item either by choice, if administered the pilot fonn containing the item, or simply 
because they were not administered that form). We analyzed distractors, seeking to retain well- 
functioning items in which students with the highest average estimated ability selected the 
correct answer choice, thus demonstrating the highest average person measure, while students 
with lower average estimated ability selected one of the remaining answer options. As described 
earlier, we attempted to write items with one near distractor and one far distractor. Items 
functioning well would thus demonstrate near distractors with average person measure values 
slightly below that of the correct response option and far distractors with lower average person 
measure values. 

Discussion 

As instruction in public schools across the United States moves in closer alignment with 
the CCSS, it is important for formative student assessment to also move in that direction given 
that the results of such assessment are regularly used to inform instructional decision-making 
within RTI contexts. To a growing degree, the validity of instructional decision-making in these 
contexts depends on both the alignment between adopted fonnative assessments and the CCSS 
and also the technical adequacy of such assessments. In this series of technical reports, we 
described the development and scaling of the easyCBM CCSS Math assessments for grades K-5, 
designed for use within an RTI framework of instruction and formative assessment in elementary 


classrooms. 
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Table 1 

Fifth Grade Item Writing Plan by CCSS Standard 


CCSS Standard 

Item Set 1 

Item Set 2 

Item Set 3 

Item Set 4 

Existing 
BM Align 

Total 

OA1 

9 

9 

8 

8 

1 

34 

OA2 

8 

8 

8 

9 

0 

33 

OA3 

8 

8 

9 

8 

0 

33 

NBT1 

3 

4 

4 

4 

2 

15 

NBT2 

4 

4 

4 

3 

2 

15 

NBT3 

5 

5 

5 

5 

0 

20 

NBT4 

4 

3 

4 

4 

2 

15 

NBT5 

5 

5 

5 

5 

0 

20 

NBT6 

4 

4 

3 

4 

3 

15 

NBT7 

0 

0 

0 

0 

13 

0 

NF1 

0 

0 

0 

0 

9 

0 

NF2 

3 

4 

4 

4 

2 

15 

NF3 

5 

5 

5 

5 

0 

20 

NF4 

4 

4 

4 

3 

1 

15 

NF5 

5 

5 

5 

5 

0 

20 

NF6 

4 

4 

3 

4 

1 

15 

NF7 

4 

3 

4 

4 

2 

15 

MD1 

7 

7 

8 

8 

0 

30 

MD2 

8 

8 

7 

7 

0 

30 

MD3 

0 

0 

0 

0 

9 

0 

MD4 

5 

5 

5 

5 

3 

20 

MD5 

5 

5 

5 

5 

4 

20 

G1 

7 

6 

6 

6 

0 

25 

G2 

6 

6 

6 

7 

0 

25 

G3 

6 

6 

7 

6 

0 

25 

G4 

6 

7 

6 

6 

0 

25 

Set total 

125 

125 

125 

125 

54 

500 


Note. Item Sets 1-4 reflect items written to each CCSS standard based on results from our 
previous alignment study (Park et al., 2012), reflected in Existing BM Align column. Total 
represents the number of math items written to a given CCSS standard in the current study. 
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Table 2 


Grades 3-5 Piloting Plan 


Form 

Cl 

C2 

C3 

C4 

C5 

C6 

C7 

C8 

C9 

CIO 

Cll 

C12 

C13 

C14 

C15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

31 

36 

2 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

3 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

4 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

5 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

6 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

7 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

8 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

9 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

3 

31 

36 

10 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

2 

31 

36 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

3 

31 

36 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

2 

31 

36 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

3 

31 

36 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

2 

31 

36 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

0 

31 

36 


Form 

N1 

N2 

N3 

N4 

N5 

N6 

N7 

N8 

N9 

N10 

Nil 

N12 

N13 

N14 

N15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

31 

36 

2 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

3 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

4 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

5 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

6 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

7 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

8 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

9 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

2 

31 

36 

10 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

3 

31 

36 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

2 

31 

36 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

3 

31 

36 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

2 

31 

36 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

3 

31 

36 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

0 

31 

36 


Note. C = CCSS pool anchor item; N = NCTM pool anchor item. Anchor items appearing in a vertical column (both CCSS or 
NCTM) were shared between the specified forms. For example, fonn 3 and form 4 shared 3 anchor items from the CCSS pool (set 
C3) and 2 from the NCTM pool (set N3). 
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Table 3 


Grades K-5 Piloting Participation Statistics 



Grade K 



Grade 1 



Grade 2 


Form 

Completed 


Form 

Completed 


Form 

Completed 


1 

48 

55 

1 

77 

84 

1 

97 

110 

2 

48 

51 

2 

70 

79 

2 

72 

251 

3 

50 

57 

3 

78 

102 

3 

85 

96 

4 

49 

56 

4 

87 

114 

4 

69 

76 

5 

48 

52 

5 

70 

77 

5 

66 

78 

6 

48 

52 

6 

70 

85 

6 

66 

78 

7 

48 

52 

7 

73 

82 

7 

66 

73 

8 

50 

52 

8 

72 

93 

8 

70 

80 

9 

50 

55 

9 

76 

85 

9 

89 

95 

10 

48 

51 

10 

73 

86 

10 

79 

88 

11 

52 

81 

11 

73 

87 

11 

75 

85 

12 

48 

54 

12 

86 

89 

12 

80 

104 

13 

47 

58 

13 

80 

99 

13 

69 

82 

14 

49 

70 

14 

70 

116 

14 

84 

85 

15 

48 

52 

15 

69 

77 

15 

69 

71 

Form Average 

49 

57 

Form Average 

75 

90 

Form Average 

76 

97 


Grade 3 



Grade 4 



Grade 5 


Form 

Completed 


Form 

Completed 


Form 

Completed 


1 

107 

250 

1 

104 

118 

1 

97 

135 

2 

107 

197 

2 

94 

112 

2 

110 

132 

3 

114 

128 

3 

89 

101 

3 

99 

123 

4 

118 

159 

4 

103 

115 

4 

95 

143 

5 

122 

139 

5 

119 

141 

5 

93 

102 

6 

114 

128 

6 

89 

95 

6 

99 

156 

7 

122 

146 

7 

91 

103 

7 

97 

110 

8 

110 

266 

8 

91 

111 

8 

118 

152 

9 

106 

115 

9 

104 

121 

9 

116 

133 

10 

106 

123 

10 

110 

118 

10 

103 

128 

11 

109 

116 

11 

89 

104 

11 

93 

113 

12 

119 

146 

12 

89 

118 

12 

100 

142 

13 

109 

170 

13 

103 

110 

13 

100 

121 

14 

116 

192 

14 

108 

232 

14 

111 

139 

15 

106 

136 

15 

116 

138 

15 

94 

105 

Form Average 

112 

161 

Form Average 

100 

122 

Form Average 

102 

129 


Note. Many test forms were started though not completed, thus, the number of student responses per item varies within form, as shown in Appendices B and D. 
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Table 4 


Fifth Grade Item Difficulties by Test Form (without adjacent grade vertical anchor items) 


Item # 

PM1 

PM2 

PM3 

PM4 

PM5 

PM6 

PM7 

PM8 

PM9 

PM 10 

BMF 

BMW 

BMS 

Mean 

1 

0.07 

0.13 

0.17 

0.27 

0.33 

0.36 

0.37 

0.41 

0.42 

0.43 

0.41 

0.41 

0.41 

0.322 

2 

1.32 

1.25 

1.27 

1.20 

1.22 

1.19 

1.19 

1.15 

1.08 

1.07 

1.29 

1.28 

1.28 

1.215 

3 

1.43 

1.56 

1.42 

1.62 

1.62 

1.50 

1.48 

1.64 

1.46 

1.65 

1.52 

1.53 

1.53 

1.535 

4 

2.23 

2.17 

2.13 

1.97 

2.00 

2.01 

1.90 

1.90 

1.90 

1.91 

2.10 

2.10 

2.10 

2.032 

5 

-0.67 

-0.75 

-0.73 

-0.71 

-0.69 

-0.71 

-0.67 

-0.70 

-0.75 

-0.74 

-0.72 

-0.72 

-0.72 

-0.714 

6 

-0.46 

-0.50 

-0.49 

-0.48 

-0.48 

-0.47 

-0.46 

-0.50 

-0.46 

-0.46 

-0.48 

-0.48 

-0.48 

-0.477 

7 

-0.27 

-0.29 

-0.28 

-0.28 

-0.24 

-0.29 

-0.23 

-0.29 

-0.26 

-0.22 

-0.25 

-0.25 

-0.25 

-0.262 

8 

0.00 

-0.02 

-0.02 

-0.01 

-0.03 

-0.03 

-0.03 

-0.02 

0.00 

0.01 

-0.03 

-0.03 

-0.03 

-0.018 

9 

0.20 

0.21 

0.21 

0.21 

0.18 

0.18 

0.18 

0.19 

0.23 

0.23 

0.20 

0.20 

0.20 

0.202 

10 

0.46 

0.44 

0.40 

0.44 

0.41 

0.44 

0.45 

0.43 

0.46 

0.47 

0.42 

0.42 

0.42 

0.435 

11 

1.22 

1.24 

1.24 

1.23 

1.18 

1.18 

1.17 

1.14 

1.14 

1.12 

1.18 

1.18 

1.18 

1.185 

12 

-1.14 

-1.20 

-1.09 

-1.16 

-1.14 

-1.10 

-1.19 

-1.16 

-1.17 

-1.08 

-1.15 

-1.15 

-1.15 

-1.145 

13 

-0.45 

-0.48 

-0.48 

-0.45 

-0.45 

-0.43 

-0.50 

-0.52 

-0.51 

-0.53 

-0.47 

-0.46 

-0.46 

-0.476 

14 

0.48 

0.48 

0.49 

0.45 

0.50 

0.44 

0.44 

0.51 

0.49 

0.51 

0.46 

0.45 

0.46 

0.474 

15 

1.09 

1.05 

1.04 

1.04 

1.08 

1.06 

1.07 

1.03 

1.09 

1.07 

1.08 

1.08 

1.08 

1.066 

16 

1.61 

1.60 

1.63 

1.59 

1.58 

1.53 

1.63 

1.59 

1.52 

1.53 

1.55 

1.55 

1.56 

1.575 

17 

-1.81 

-1.93 

-1.89 

-1.93 

-1.86 

-1.88 

-1.80 

-1.86 

-1.89 

-1.94 

-1.84 

-1.84 

-1.84 

-1.870 

18 

-1.17 

-1.06 

-1.13 

-1.17 

-1.14 

-1.18 

-1.18 

-1.02 

-1.07 

-1.04 

-1.11 

-1.11 

-1.10 

-1.114 

19 

-0.12 

-0.11 

-0.13 

-0.17 

-0.06 

-0.10 

-0.06 

-0.04 

-0.02 

-0.09 

-0.08 

-0.08 

-0.08 

-0.088 

20 

0.21 

0.24 

0.16 

0.23 

0.21 

0.18 

0.29 

0.25 

0.28 

0.18 

0.22 

0.22 

0.22 

0.222 

21 

0.85 

0.84 

0.73 

0.77 

0.80 

0.78 

0.83 

0.74 

0.88 

0.75 

0.79 

0.79 

0.78 

0.795 

22 

1.53 

1.49 

1.40 

1.43 

1.44 

1.45 

1.45 

1.39 

1.52 

1.39 

1.43 

1.43 

1.43 

1.445 

23 

-0.04 

0.05 

0.10 

0.14 

-0.18 

0.15 

-0.16 

-0.15 

-0.10 

-0.05 

-0.01 

0.01 

0.01 

-0.018 

24 

0.33 

0.34 

0.43 

0.46 

0.54 

0.54 

0.52 

0.51 

0.51 

0.48 

0.39 

0.39 

0.39 

0.448 

25 

0.75 

0.86 

0.99 

0.97 

0.88 

0.83 

0.98 

1.02 

0.90 

1.02 

0.96 

0.95 

0.94 

0.927 

26 

-1.27 

-1.26 

-1.26 

-1.26 

-1.26 

-1.26 

-1.25 

-1.25 

-1.24 

-1.21 

-1.24 

-1.24 

-1.25 

-1.250 

27 

-0.28 

-0.28 

-0.29 

-0.32 

-0.33 

-0.34 

-0.35 

-0.35 

-0.35 

-0.38 

-0.33 

-0.33 

-0.33 

-0.328 

28 

-0.15 

-0.15 

-0.15 

-0.17 

-0.18 

-0.11 

-0.13 

-0.13 

-0.13 

-0.13 

-0.15 

-0.14 

-0.15 

-0.144 

29 

0.65 

0.65 

0.66 

0.67 

0.67 

0.59 

0.60 

0.62 

0.62 

0.64 

0.63 

0.62 

0.62 

0.634 

30 

0.92 

0.91 

1.00 

1.03 

0.93 

1.05 

1.00 

1.03 

1.08 

1.06 

1.00 

0.98 

1.01 

1.000 

Mean 

0.251 

0.252 

0.251 

0.254 

0.251 

0.252 

0.251 

0.252 

0.254 

0.255 

0.259 

0.259 

0.259 

0.254 


Note. PM1 to PM10 = Progress Monitoring Form 1 to Form 10; BMF = Benchmark Fall, BMW = Benchmark Winter, BMS = Benchmark Spring; 
Green = horizontal anchor items. 
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Appendix A: Training Materials 
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Common Core State Standards (CCSS) 
Math Item Writing and Review 

Supplementing the easyCBM math 
assessment system 


easyCBM 

• easyCBM is an online benchmark and progress 
monitoring assessment system. 

• Designed to inform teachers' classroom-based 
instructional decisions 

• Used within Response to Intervention (RTI) 
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easyCBM in Use 

• What are your experiences with easyCBM? 

Popularity of the System 

• Registered users in all 50 states 

• Over 2 million students in the system 

• Over 800,000 teachers in the system 

• Growing exponentially 

• Over 9000 new registered teacher users every 
month; with district-level subscribers growing 


Within RTI (very general) 



Standards, instruction and assessment must align 
for accurate decision-making and inferences! 
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Item 


Before we get too far: 
Vocabulary 


(Question) 

Stem 



Project Overview 

• Develop 3,000 new math items for easyCBM 
in grades K-5; 500 items per grade 

- Aligned with the Common Core State Standards 
(CCSS) 

- Piloted in April/May to examine their technical 
adequacy and establish difficulty 

— Developed items will be assembled with existing 
items that were aligned to CCSS into 20 test forms 
per grade (60 forms total). 

- Each form will have 25 items for use in easyCBM 

- Anticipated release date of Fall 2013 


easyCBM CCSS Fifth Grade Math Measure Development 


32 

Appendix A: Training 


Existing Items vs. Items to be Developed 

Existing Items 

Items to be Developed 

• Originally developed for the 

• Should be developed for 

2% population (i.e., 

students performing at or 

students performing well 

slightly below grade-level 

below grade-level 

expectations. 

expectations) 

• Aligned to the NCTM Focal 
Point Standards 

• Aligned to the CCSS 


Common Core Standards (see PDF) 

Grade K 

Standard Domains 

• Counting and Cardinality (KCC) 

• Operations and Algebraic Thinking (KOA) 

• Number and Operations in Base Ten (KNBT) 

• Measurement and Data (KMD) 

• Geometry (KG) 

24 standards divided among 5 domains. 
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Outline of GrK Items to be Written/Reviewed 



Item Set 2 

Item Set 3 

Item Set 4 

Item Set 5 

CCSS B M Alien 

Total 

CCl 

5 

5 

6 

6 

0 

22 

CC2 

1 

1 

1 

1 

6 

4 

CC3 

6 

6 

5 

5 

1 

22 

CC4 

1 

1 

1 

1 

5 

4 

CCS 

5 

5 

6 

6 

3 

22 

CC6 

1 

1 

1 

1 

5 

4 

CC7 

6 

6 

5 

5 

2 

22 

SI 

1 

1 

1 

1 

6 

4 

G2 

1 

1 

1 

1 

7 

4 

S3 

10 

10 

11 

11 

2 

42 

G4 

1 

1 

1 

1 

5 

4 

G5 

11 

11 

10 

10 

0 

42 

G6 

1 

1 

1 

1 

8 

4 

MD1 

4 

4 

4 

4 

5 

16 

MD2 

2 

2 

2 

2 

9 

8 

MD3 

19 

19 

19 

19 

4 

76 

NBT1 

25 

25 

25 

25 

1 

100 

DAI 

5 

5 

5 

5 

3 

20 

DA2 

5 

5 

5 

5 

3 

20 

0A3 

5 

5 

5 

5 

0 

20 

OA4 

5 

5 

5 

5 

1 

20 

OA5 

5 

5 

5 

5 

3 

20 

Set Total 

125 

125 

125 

125 


500 


Common Core Standards (see PDF) 

Grade 1 

Standard Domains 

• Operations and Algebraic Thinking (10A) 

• Number and Operations in Base Ten (1NBT) 

• Measurement and Data (1MD) 

• Geometry (1G) 


21 standards divided among 4 domains. 
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Outline of Grl Items to be Written/Reviewed 



hem Set 2 

hem Set 3 

hem Set 4 

hem Set 5 

CCSS B M Alien 

Total 

61 

10 

10 

10 

10 

4 

40 

62 

10 

10 

10 

10 



63 

12 

11 

11 

11 

1 

45 

MD1 

8 

8 

8 

8 

1 

32 

MD2 

8 

8 

8 

8 

0 

32 

MD3 

8 

8 

8 

8 

0 

32 

MM 

7 

7 

7 

8 

3 

29 








NBT2 

1 

2 

1 

1 

5 

5 

NBT3 

10 

10 

10 

10 

2 

40 








NBT3 

10 

10 

10 

10 

0 

40 

NBT6 

10 

10 

10 

10 

0 

40 








OA2 

6 

6 

7 

6 

4 

25 








044 

6 

6 

6 

7 

1 

25 

0A3 

6 

7 

6 

6 

1 

25 








0A7 

6 

6 

7 

6 

0 

25 

0A8 

7 

6 

6 

6 

3 

25 

Set Total 

125 

125 

125 

125 


500 


Common Core Standards (see PDF) 

Grade 2 

Standard Domains 

• Operations and Algebraic Thinking (20A) 

• Number and Operations in Base Ten (2NBT) 

• Measurement and Data (2MD) 

• Geometry (2G) 


26 standards divided among 4 domains. 
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Outline of Gr2 Items to be Written/Reviewed 






hem Set 2 

Item Set 3 

Hem Set 4 

hem Set 5 

CCSS BM Alien 

Total 


si 

10 

10 

11 

11 

0 

42 

G2 

10 

11 

10 

10 

3 

41 

S3 

11 

11 

10 

10 

0 

42 








MD2 

3 

3 

3 

3 

3 

12 

MD3 

4 

3 

4 

4 

0 

15 

MD4 

3 

4 

4 

4 

0 

15 

WD5 

4 

4 

4 

3 

0 

15 

MD6 

3 

3 

3 

4 

2 

13 

>4 07 

3 

3 

3 

3 

3 

12 

MD8 

4 

3 

3 

3 

2 

13 

MD9 

3 

4 

4 

4 

0 

15 

MD10 

4 

4 

4 

3 

0 

15 








NBT2 

5 

5 

5 

5 

0 

20 

•4BT3 

5 

5 

5 

5 

0 

20 








NBT5 

1 

1 

1 

2 

5 

5 

NBT6 

5 

5 

5 

5 

0 

20 

NBT7 

5 

5 

5 

5 

2 

20 

NBT8 

5 

5 

5 

5 

2 

20 

NBT9 

5 

5 

5 

5 

0 

20 

OA1 

2 

1 

1 

1 

7 

5 

QA2 

10 

10 

10 

10 

3 

40 

OA3 

10 

10 

10 

10 

0 

40 

OA4 

10 

10 

10 

10 

1 

40 


125 

125 

125 

125 


500 





Common Core Standards (see PDF) 

Grade 3 

Standard Domains 

• Operations and Algebraic Thinking (30A) 

• Number and Operations in Base Ten (3NBT) 

• Number and Operations-Fractions (3NF) 

• Measurement and Data (3MD) 

• Geometry (3G) 

25 standards divided among 5 domains. 
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Outline of Gr3 Items to be Written/Reviewed 



Item Set 2 

Item Set 3 

Item Set 4 

Item Set 5 

CCSS BM Alien 

Total 

OAl 

5 

5 

5 

5 

3 

20 















OA4 

5 

5 

5 

5 

4 

20 

OA5 

5 

5 

5 

5 

2 

20 

OA6 

5 

5 

5 

5 

3 

20 








OA8 

5 

5 

5 

5 

3 

20 








NBT1 

8 

9 

9 

8 

0 

34 

NBT2 

9 

8 

8 

8 

0 

33 

NBT3 

8 

8 

8 

9 

1 

33 








NF2 

20 

20 

20 

20 

1 

SO 

NF3 

5 

5 

5 

5 

5 

20 

MD1 

3 

3 

3 

4 

0 

13 

MD2 

4 

3 

3 

3 

0 

13 

MD3 

3 

3 

4 

3 

0 

13 

MD4 

3 

4 

3 

3 

0 

13 

MD5 

3 

3 

3 

3 

0 

12 

MD6 

3 

3 

3 

3 

1 

12 

MD7 

3 

3 

3 

3 

0 

12 

MDfi 

3 

3 

3 

3 

1 

12 

G1 

20 

20 

20 

20 

4 

SO 

62 

5 

5 

5 

5 

15 

20 


125 

125 

125 

125 


500 


Common Core Standards (see PDF) 

Grade 4 

Standard Domains 

• Operations and Algebraic Thinking (40A) 

• Number and Operations in Base Ten (4NBT) 

• Number and Operations-Fractions (4NF) 

• Measurement and Data (4MD) 

• Geometry (4G) 

28 standards divided among 5 domains. 
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Outline of Gr4 Items to be Written/Reviewed 



Common Core Standards (see PDF) 

Grade 5 

Standard Domains 

• Operations and Algebraic Thinking (50A) 

• Number and Operations in Base Ten (5NBT) 

• Number and Operations-Fractions (5NF) 

• Measurement and Data (5MD) 

• Geometry (5G) 

26 standards divided among 5 domains. 
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Outline of Gr5 Items to be Written/Reviewed 



Item Set 2 

Hem Set 3 

Hem Set 4 

Item Set 5 

CCSS BM Alien 

Total 

OAl 

9 

9 

8 

8 

1 

34 

OA2 

8 

8 

8 

9 

0 

33 

0A3 

8 

8 

9 

8 

0 

33 

NBT1 

3 

4 

4 

4 

2 

15 

NBT2 

4 

4 

4 

3 

2 

15 

NBT3 

5 

5 

5 

5 

0 

20 

NBT4 

4 

3 

4 

4 

2 

15 

NBT5 

5 

5 

5 

5 

0 

20 

NBT6 

4 

4 

3 

4 

3 

15 















NF2 

3 

4 

4 

4 

2 

15 

NF3 

5 

5 

5 

5 

0 

20 

NF4 

4 

4 

4 

3 

1 

15 

KF5 

S 

5 

5 

5 

0 

20 

f»F6 

4 

4 

3 

4 

1 

15 

NF7 

4 

3 

4 

4 

2 

15 

MD1 

7 

7 

8 

8 

0 

30 

M02 

8 

8 

7 

7 

0 

30 








M04 

5 

5 

5 

5 

3 

20 

M05 

S 

5 

5 

5 

4 

20 

G1 

7 

6 

6 

6 

0 

25 

G2 

6 

6 

6 

7 

0 

25 

G3 

6 

6 

7 

6 

0 

25 

G4 

6 

7 

6 

6 

0 

25 


125 

125 

125 

125 


500 


Why So Many New Items? 

1. No matter how perfect an item looks, there 
are always quirks. 

- We need 250-300 "good" items per grade. 

- If we write 500 items per grade, we can "weed 
out" the poor items. 

2. The surplus of items also allows us to 
assemble items into test forms (i.e., seasonal 
benchmarks and progress-monitoring) of 
comparable difficulty. 
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Purpose 1 

Example: Two Similar Items 

Item 1 Item 2 


A. 

6 

15 

A. 4 

B. 

8 

p 

B * 18 

C. 

JL 

r, 

C. 1 


Purpose 1 

Example (continued) 

• Although the previous two items look very 
similar, our statistical analyses of the items 
functioning indicate that Item 1 is functioning 
quite well, while Item 2 is functioning quite 
poorly. 

• Item 2 was determined to be functioning poorly 
enough that it was removed 

• Despite the similarities in item construction, the 
students' responses to the items are very 
different (i.e., matching student ability w/ 
question difficulty). 
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Purpose 1 
Recap 

Item 1 Item 2 


i*i = _ 


a. -Hr a- 7 

b. { Good Item B -w Poor Item 

Why? It's difficult to say for sure, but is part of why we need to write a 
surplus of items 


Purpose 2 
RTI 

• RTI requires multiple test forms of equivalent 
difficulty 

• If forms are not equivalently difficult, 
assumptions about the growth students make 
and/or the effectiveness of instruction or an 
intervention may not be accurate 
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Purpose 2 
(Continued) 

• Growth? 

- What if first three 
forms were unusually 
difficult and the last 
two forms were 
unusually easy? 

• We need to have a sufficient number of items 
to ensure that forms actually are, statistically 
speaking, equivalently difficult. 


G*«d« 1. Wo id H« ini| FluMicy: Jufa Aton?® 



(•M Grea* 

£ ifl 

.u,_ • 

• 

sa - 




/ / s 

D«ta of AnainiliHtM 

Or»il 30 nvuimr on awcutor 


10PB • '30PB SOpb 90p* 


Your Role As the Item Writer and 
Item Reviewer 

A Concurrent Process of Item 
Writing , Reviewing , and Submission 
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Your role as the Item Writer 

• Become an "item writing expert" 

- Thoroughly review the CCSS associated with the 
grade-band you have been assigned (i.e., K-l, 2-3, 
and 4-5). 

- Review "example items" in ItemSet spreadsheet. 

• Complete two ItemSet spreadsheets, 
consisting of 125 items for each grade of your 
assigned grade band (i.e., 125 grade K items, 
and 125 grade 1 items for K-l grade band) 

• Thoroughly review all items written before 
turning items in to BRT (in batches). 


Your role as the Item Reviewer 

• Become an "item writing expert" 

- Thoroughly review the CCSS associated with the 
grade that you have been assigned (i.e., K, 1, 2, 3, 
4, or 5). 

- Review "example items" in ItemSet spreadsheet. 

• Review and edit 500 grade-level items from 
the 4 ItemSets (in batches). 

• Thoroughly review all items written before 
turning items in to BRT (in batches, by 
ItemSet). 
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Excel ItemSet Template cont. 

• Each ItemSet consists of 125 items 

• Item Writers will write all 125 items and fill out the 
excel sheet. 

- After writing items into the excel file, the Item Writer 
should add an underscore and their initials after the 
version number to save it 

• e.g., Item Writer = Shawn Irvin: 

G2ltemSet2.xlsx G2ltemSet2_Sl.xlsx 

• Each Item Writer will write items to specific CCSS, 
most times multiple items per standard 

• The number of items per domain will vary by Item 
Writer and grade. 


Excel ItemSet Template 


•rtnv ■■«!* f"* (Mfr i* r*«i i* id'r ?frtr 


.. Kli-iv 1 IhiKi" Hhtn 1 MMn Mlfim' ***.*?, V !! 


emt •»«» j wtn»r o. 


Sir- 


Write one Question (stem) and three 

Answer options in these cells 

• Option A is always the correct 
answer 

• Options B and C are always 
incorrect, but plausible distractor 
responses 


The "home" for all of the items we write and review!!! 
These ItemSet spreadsheets will be passed from Writers to 
me to Reviewers and back to me for an in-house review. 
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Item ID Naming Convention 

• It is crucial that all items written are filled out 
in the excel sheet appropriately 

• Graphics accompanying an item MUST BE 
given the same ID because the graphic is part 
of the item. 

- If the wrong ID is assigned to the graphic, it will 
either be lost or accompany the wrong item. 
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Graphics (images) in Items 

• First rule of graphics - they are expensive 

- Adds, on average, around $50 to the total cost of the 
item 

• Does this mean graphics should not be used? 

- No, but it does mean that graphics should only be used if 
they (a) increase the clarity of the item or (b) are 
essential to the content of the item (i.e., in geometry) 

- Graphics may be necessary for some standards! 

• There is also no clear research on the effect of 
adding a graphic to an item (Kettler, Elliott, & 
Beddow, 2009) 


Graphics in Items (cont.) 

• Graphics can be in question/stem, and/or in 
answer options! 

• If you as an Item Writer or Reviewer want to 
add graphics, they have two options: 

1. Describe what the graphic will look like in detail in 
the excel sheet (recommended if the graphic is 
simplistic). 

2. Draw the graphic by hand or use clipart from the 
web in the "Graphics Template" provided. 
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Describe what the graphic will look like in 
detail in the excel sheet (recommended if the 
graphic is simplistic). 





tW«Ttax >«»•••«■< P >»«?»•«*' *i If**. 

4>mBE 5 ftjwagpna ‘V^inJTTr^ 


M!> M • 




!C< i 

»r*» '*■'» 

*«ra niMn mo » i 

iMunMHtaatnM- r.rM « J • rM 'iMn ll 

otoo 

u**» 




Norbi r< •••*'* 

, !»■ r i»— » w »»■ 

nbM 





Protocol for Hand Drawn Graphics 


• Draw the graphic by hand using "Graphic Template" 

• Matching Item ID exactly! 


jgmeir^ l tyl \y- 




J U 


llom_ 3 Of 5 & P"9 


© isms El 


easyCBM CCSS Fifth Grade Math Measure Development 


47 

Appendix A: Training 


Protocol for Hand Drawn Graphics 
(as it is seen in easyCBM) 



The head is a 


A. wangle 

B. circle 

C. square 


Protocol for Hand Drawn Graphics 

• Use clipart from the web and enter into "Graphics 
Template" 

http://www.fotosearch.com/ 



Note. We will not use any of the clipart in the actual items, 
but it is a way to communicate approximately what the 
graphic should look like. 
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Use Basic Codes in ItemSet Spreadsheets 

(see ExampleSheet K-5CCSS.docx for more) 

• Image: [img]item_7NS3008.png[/img] 

• Division symbol: Bt 4 = 3[divide]4 = 3[div]4 

• Long division: 3[longdiv]42[/longdiv] 

• Square roots: V25 = [squareroot]25[/ 
squareroot] 

• Pi: Jt = [pi] 

• Vertically stacked add/sub/multiply: 

[plus]30:40:12[/plus] 30 

40 
+ 12 


Excel Sheet (see Example Problems) 
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The Basic Process 

Item Writers: 

• You will write and turn items in batches, 
approximately ~20-40 items at a time, and email 
them to me for a quick check for completeness 
and quality, with all 250 items, two completed 
ItemSet spreadsheets due by Friday, January 11 th , 
2013. 

• I will email OKd items to Item Reviewers. 

• Item Reviewers will individually be reviewing, 
editing aj[ items for ways to improve them, and 
returning them to me, but they should be a 
strong as you can get them before emailing them 
to me. 


The Basic Process (cont.) 

Item Reviewers: 

• After you have reviewed/edited all items in an 
item set and deemed them to be (a) aligned to 
the standard, (b) mathematically accurate, (c) 
grade-level appropriate, (d) free of bias, and (e) 
"good" overall items, you turn in the ItemSet 
spreadsheet to me at BRT. 

• Email items back to me in batches, a full ItemSet 
(i.e., 125 group of grade-level items from a single 
Item Writer) at a time -> you will turn in a total 
of four of these for your grade, with all ItemSets 
due by Friday, January 25 th , 2013 
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Deadlines and Compensation 

• Compensation will be released upon completion 
of your work, pending approval by BRT and the 
University of Oregon (me) 

• $800 for Item Writers completing two ItemSets 
of 125 items each, 250 total -> January, 11 th , 
2013 

• $1500 for Item Reviewers for reviewing/editing 
500 grade-level math items -> January, 25 th , 
2013 


Study-related or 
Procedural 
QUESTIONS? 
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Some Basic Item Writing 
Guidelines 
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Why multiple 

choice items? 

“Selected-response items are the most appropriate item 

format for measuring cognitive achievement or ability, 

especially higher order cognitive achievement or cognitive 

abilities, such as problem solving, synthesis, and 

evaluation.” (Downing, 2006, p. 288) 

• Validity 

• Efficiency 

— Less chance of 

— Easy to administer 

construct irrelevant 

— Easy to produce 

variance in scores 

— Easy to score 

— Allow a given skill 

objectively (as 

to be assessed 

opposed to 
constructed 

multiple times 

response item 

(multiple items) 

types) 


How do you write a good item? 

Art or SCIENCE? (maybe a little of both) 


Answer Options : 

• Use only 3 options: 1 
correct response and 2 
distracters 

• Choose logical distracters 

• Avoid excess text or 
irrelevant features 


Assess Only Target Knowledge : 

• Targeting Math 

• Reduce language as much as 
possible 

• If the item is supposed to 
assess fractions, make sure it 
doesn't assess other factors, 
such as conversions or 
estimations. 

Be Sensitive of Bias Issues : 

• Keep in mind the population of 
students who will be taking the 
items 

• Consider ELL, SWD, diverse 
cultures, etc. 
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Universal Design 

How should we design a building so the widest range 
of populations possible can access it? 



Universal Design for Assessment 


• Considers all characteristics of test-takers. 

• Precisely defined constructs. 

• Accessible, non-biased items. 

•" Items amendable foaccommodanonsl j 

• Simple, clear, and intuitive instructions and j 

procedures. I 


Maximum readability and comprehensibility. 

Maximum legibility of text, tables, figures, and 
illustrations 


Thompson, Johnstone, and Thurlow (2002) 
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TABLE 1 

A Revised Taxonomy of Multiple-Choice (MC) hem- Writing Guidelines 


Content concerns 

1. Every item should reflect specific content and a single specific menial behavior, as called for in 
test specifications (two-way grid, test blueprint). 

2. Base each item on important content to learn: avoid trivial conlenL 

3. Use novel material to test higher level learning. Paraphrase textbook language or language used 
during instruction when used in a test item to avoid testing for simply recall. 

4. Keep the content of each item independent from content of other items on the tesL 

5. Avoid over specific and over general content when writing MC items. 

6. Avoid opinion-based items. 

7. Avoid trick items. 

8. Keep vocabulary simple for the group of students being tested. 

Formatting concerns 

9. Use the question, completion, and best answer versions of the conventional MC, the alternate 
choice, true-false (TF). multiple true-false (MTF). matching, and the context-dependent item 
and item set formats, but AVOID the complex MC (Type K) format. 

10. Format the item vertically instead of horizontally. 

Style concerns 

1 1. Edit and proof items. 

12. Use correct grammar, punctuation, capitalization, and spelling. 

13. Minimize the amount of reading in each item. 

Writing the stem 

14. Ensure that the directions in the stem are very clear. 

15. Include the central idea in the stem instead of the choices. 

16. Avoid window dressing (excessive verbiage). 

17. Word the stem positively, avoid negatives such as NOT or EXCEPT. If negative words are used, 
use the word cautiously and always ensure that the word appears capitalized and boldface. 


TABLE 1 

A Revised Taxonomy of Multiple-Choice (MC) Hem-Writing Guidelines 


Writing the choices 

18. Develop as many effective choices as you can. but research suggests three is adequate. 

19. Make sure that only one of these choices is the right answer. 

20. Vary the location of the right answer according to the number of choices. 

21 . Place choices in logical or numerical order. 

22. Keep choices independent: choices should not be overlapping. 

23. Keep choices homogeneous in content and grammatical structure. 

24. Keep the length of choices about equal. 

25. None-of-lhe-uboxe should be used carefully. 

26. Avoid All-of-the -above. 

27. Phrase choices positively: avoid negatives such as NOT. 

28. Avoid giving clues to the right answer, such as 

a. Specific determiners including always, never, completely, and absolutely. 

b. Clang associations, choices identical to or resembling words in the stem. 

c. Grammatical inconsistencies that cue the test-taker to the correct choice. 

d. Conspicuous correct choice. 

e. Pairs or triplets of options that clue the test-taker to the correct choice. 

f. Blatantly absurd, ridiculous options. 

29. Make all distractors plausible. 

30. Use typical errors of students to write your distractors. 

31. Use humor if it is compatible with the teacher and the learning environment. 


Haladyna, 2002, p. 312 
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Content Concerns 

“Every item should reflect specific content and a single 
specific cognitive process” (Haladyna, 2004, p. 98). 

Guidelines 

• Write/review items that align with only one standard 
(or one part of one standard), and that the item 
targets that standard clearly and directly. 

— Target only one skill in each item. If standard asks for 
multiple skills, use multiple items. 

• Try not to be over-specific or over-general. 

• Try not to "trick the students" 

• Each item should be independent of all others. 

• Avoid focusing items on trivial parts of standards. 

• Present items in novel formats 

Note. The following slides are largely based on Haladyna, 2004. 


Targeting Only One Skill 

Standard 6.SP: Recognize that a measure of center for a numerical data set summarizes all of 
its values with a single number, while a measure of variation describes how its values vary with 

a single number. 


Example item 1 

Example item 2 

Which number 

Which number 

describes the center of 

describes the center of 

the dataset? 

the dataset? 

Dataset: 5, 7, 3, 3 

Dataset: 5, 7, 3, 3 

A) Average -4.50 

A) 4.50 

B) Standard deviation - 1.91 

B) 1.91 

C) Range -4.00 

C) 4.00 
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Targeting Only One Skill 

Example item 1 

Example item 2 

• The first item provides the 

• Second item requires 

student with the name of 

student to both know the 

the statistic AND the 

best statistic (average) AND 

number. 

to recognize which number 

• The target skill of the item 
(measure of central 

represents that statistic. 

tendency) is not confused 

• Item has less text, but in 

with other math skills. 

this case, the text may help 

HOWEVER - 
• Item still requires 

vocabulary and additional 
reading skills over a simpler 
version 

target the skill of interest. 


Targeting Only One Skill 

• Both items target only one part of the 
standard (central tendency), yet item 2 still 
targets multiple math skills. 

— Note: if we were interested in knowing students' 
skills with calculating the average, we could easily 
address it with a different item. 

Example 

The average of: 4, 3, 9, 4 = ? 

- A) 5 

- B) 20 
-C)4 
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Over-specific/Over-general 

Over-specific item 

Over-general item 

Who wrote the Icon of Seville? 

Which is the most serious 

A) Lorca 

problem in the world? 

B) Ibanez 

A) hunger 

C) Rodriguez 

B) lack of education 

C) disease 

Over-specific items often assess 

Over-general items are often 

trivial content. 

opinion-based. 

Balancing the generality of an item is 

part of the "art" of writing good items. 

Note. Examples from Haladyna, 2004, p. 102. 


Trick Questions 

• Is there a fourth of July in England? 

Yes, there is a fourth of July everywhere. 

• Some months have 31 days. How many have 
28? 

All of them 

• How many animals of each gender did Moses 
bring on his ship? 

None. Moses didn't have a ship, Noah did. 

• A butcher in the meat market is six feet tall. 
What does he weigh? 

Meat 

Note. Examples from Haladyna, 2004, p. 104. 
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Trick Questions 

“There are enough problems in testing 
without contributing more by using trick 
items.” (Haladyna, 2004, p. 104) 


Formatting Concerns 

• Make sure stem is a complete sentence/ 
directive. 

• Make sure item is multiple choice, and 
contains three options (correct response and 
two plausible distracters). 

• Correct response is always answer Option A 

— Because items will be computer-administered, we 
will randomly rotate all options. For development 
purposes, it's easiest to always keep the correct 
response in a consistent location. 

All other formatting concerns are BRT responsibility 
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Style Concerns 

• Please proof read all items you wrote before you 
turn them over to me (both Writers and 
Reviewers) 

• Primary things to look for: 

— Grammar 

- Can the reading load be reduced without losing 
clarity? 

— Is there more than one construct/skill? 

— Bias and sensitivity (i.e., variety of diverse names - 
Google them!) 


Stem Construction 

• Try to be as clear and concise as possible 

• Make sure the stem is complete and contains 
all the information needed to solve the 
problem. 
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Developing Options (correct option 
and two plausible distractors) 

• Probably the most difficult part of an item to 
develop. 

• Answer options must be reasonable and have 
only one justifiably correct answer (e.g., if you 
can make a reasonable argument that one of 
the distracters is also correct, it is not a good 
distracter). 

• You're an expert!!! Think about the common 
math mistakes your students make! 


Developing Options (cont.) 

In a perfectly functioning item... 

• Stem contains all the information needed to 
solve the question 

— Answer option A is the correct response, and will be 
chosen by students who understand the content 
targeted by the item. 

— Answer option B is a close distracter, and will be 
chosen by students who have partial, but incomplete 
knowledge of the content targeted by the item. 

— Answer option C is a far distracter (but not TOO far), 
and will be chosen by students who have little to no 
knowledge of the content targeted by the item. 
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Developing Options (cont.) 

• Keep format of each option the same (length, 
grammar, etc.) 

• Do not use "all of the above" or "none of the 
above" 

• Keep distracters plausible, but avoid hinting at 
the correct response. 

• Try to use distracters that represent typical 
student errors 


Developing Options (cont.) 

• Although guidelines can help, coming up with 
reasonable options is difficult. Getting the 
options to all function the way they are 
intended to is even more difficult. 

— Why some refer to item writing as an art (as 
opposed to a science) it's a little of both 
though! 
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Hypothetical Example 

• Imagine a kindergarten or first grade standard 
that requires students have knowledge of 
basic geometric shapes - faces, sides, angles, 
etc. 

— i.e., squares, circles, triangles, rectangles, etc. 


Item Non-Example 

Greg and Sally were both in the first grade. Greg 
liked the color blue and always wore a blue shirt. 
Sally liked the color green and always wore a 
green shirt. Which shirt has more triangles on 
it? 



a) blue c) Sally e) triangles 

b) green d) Greg 
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Why this is a poor item 

• Way too much text 

• Lots of irrelevant information 

• Low-cognitive-level question (basically counting - 
though some standards this skill is targeted) 

• What if the student is color blind? 

• Too many options 

- Not logical distracters 

— There is arguably more than one correct response 
option (either blue or Greg) 

• Doesn't really address the standard 


Item non-example 2 

Triangles: 

a) have three sides 

b) have two long sides and two short sides 

c) have rounded edges 

d) all of the above 

e) none of the above 
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Why this is a poor item 

• Stem does not present the information 
needed solve the problem. 

• Uses the "all of the above" and "none of the 
above" options 

— Although there is some empirical evidence 
supporting that the "all of the above" option 
increases the difficulty (Huang, Trevisan, & 
Storfer, 2007), the general consensus is that it 
creates a "cueing" effect for students. Also, 
students may choose these options with mis- or 
partial knowledge. 
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Why is this a better item? 

• Clearly addresses the standard 

• Low level of text 

• No irrelevant information 


Language Issues 


For math items, excess text threatens validity 

- Particularly worrisome for English language 
learners (ELL) 


What to do? 


— Use familiar, grade- 
level appropriate 
words 

— Omit all unnecessary 
words 

— Use no text if possible, 
or keep sentences as 
brief as possible 


— Avoid conditional 
and relative clauses 

— Avoid negation 

— Use concrete 
versus abstract 
representation 
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Now.... Time to look at some real items! 

Existing easyCBM items 


Existing easyCBM items 

• Note. There's only a limited amount we can 
learn from these items 

— Aligned to different standards 
— Developed for a different population 

However 

• Formatting will be similar 

• Universal design features evident 

• Good item writing principles applied 

• Perhaps most important - We know they work! 
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Existing easyCBM item 

Standard: Solve problems about similar objects (including figures) by using scale 
factors that relate corresponding lengths of the objects or by using the fact that 
relationships of lengths within an object are preserved in similar objects. 

• Universal Design features? 

• Targets a single skill? 

• Over-specific/over-general? 

• Clear and concise? 

• Alignment? 

• Other concerns? 

a. \ in. Remember: These items were designed for very low 

b. 4 in. performing students. The new items should target 

c. 5 in. students at or slightly below grade-level expectations. 



Existing easyCBM item 

Standard: Use descriptive statistics, including mean, median, and range, to summarize 
and compare data sets. 



B. $9 

C. $12 


• Universal Design features? 

• Targets a single skill? 

• Over-specific/over-general? 

• Clear and concise? 

• Alignment? 

• Other concerns? 
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One more... 

Standard: Explain why the sum of the measures of the angles in a triangle is 180 
degrees, and they apply this fact about triangles to find unknown measures of angles. 

• Universal Design features? 

• Targets a single skill? 

• Over-specific/over-general? 

• Clear and concise? 

• Alignment? 

• Other concerns? 

A. 38° 

B. 71° 

C. 16° 



How do you become a good item writer? 

“Effective item writers are trained, not 
born... Although item writers must be 
expert in their own disciplines, there is no 
reason to believe that their subject matter 
expertise generalizes to effective item 
writing expertise.” 

(Downing, 2006, p. 11) 
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Bottom line 

“Practice does not make perfect. Only 
perfect practice makes perfect.” 
-Vince Lombardi 

• Practice, practice, practice. 

- Practice writing different types of items 

• Geometry, number & operation, etc. 

- Look back at other test items 

• Find examples of good and bad items 


Resources 

• Multiple choice item writing Do's and Don'ts 

— http://www.eric.ed.gov/PDFS/ED398238.pdf 

• Recommendations portion of the following 
IDEA paper 

- http://www.theideacenter.org/IDEAPaperl6 

Plenty more resources online can be found with 
a quick Google search. 
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Appendix B: Item Statistics by Test Form 
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Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

1 

1 

50A225 

0.07 

111 

80 

0.23 

0.89 

-1.02 

0.90 

-0.53 

0.43 

1.18 

1 

2 

50A224 

1.32 

100 

58 

0.23 

1.08 

0.91 

1.31 

1.77 

0.35 

0.73 

1 

3 

50A321 

1.43 

93 

46 

0.23 

0.99 

-0.04 

0.96 

-0.35 

0.40 

1.05 

1 

4 

50A316 

2.23 

93 

36 

0.23 

0.93 

-0.74 

0.90 

-0.84 

0.46 

1.20 

1 

5 

50799 

-0.67 

49 

32 

0.34 

0.97 

-0.15 

0.81 

-0.53 

0.49 

1.12 

1 

6 

50641 

-0.46 

52 

34 

0.33 

1.11 

0.83 

1.00 

0.11 

0.37 

0.80 

1 

7 

50045 

-0.27 

55 

36 

0.33 

1.07 

0.51 

1.06 

0.33 

0.42 

0.87 

1 

8 

50644 

0.00 

56 

36 

0.31 

1.26 

1.95 

1.36 

1.57 

0.24 

0.35 

1 

9 

50028 

0.20 

49 

26 

0.31 

1.08 

0.84 

1.05 

0.35 

0.31 

0.70 

1 

10 

51080 

0.46 

53 

25 

0.32 

0.99 

-0.05 

0.88 

-0.40 

0.49 

1.08 

1 

11 

5NBT511 

1.22 

97 

70 

0.25 

1.04 

0.40 

0.92 

-0.27 

0.39 

0.96 

1 

12 

50096 

-1.14 

50 

40 

0.38 

1.13 

0.66 

1.30 

0.73 

0.22 

0.82 

1 

13 

50385 

-0.45 

49 

32 

0.36 

1.07 

0.47 

0.97 

0.04 

0.50 

0.90 

1 

14 

50992 

0.48 

48 

23 

0.32 

0.94 

-0.46 

0.86 

-0.46 

0.49 

1.20 

1 

15 

5NF35 

1.09 

97 

72 

0.25 

0.88 

-1.02 

0.72 

-1.11 

0.50 

1.23 

1 

16 

50989 

1.61 

49 

16 

0.35 

1.16 

0.98 

1.21 

0.86 

0.34 

0.71 

1 

17 

50270 

-1.81 

55 

48 

0.44 

1.04 

0.24 

0.73 

-0.35 

0.36 

1.01 

1 

18 

50554 

-1.17 

51 

40 

0.38 

1.26 

1.31 

1.24 

0.65 

0.23 

0.67 

1 

19 

50896 

-0.12 

49 

30 

0.33 

0.91 

-0.73 

0.75 

-0.70 

0.53 

1.30 

1 

20 

51026 

0.21 

57 

33 

0.31 

1.07 

0.60 

0.98 

0.02 

0.44 

0.87 

1 

21 

5MD57 

0.85 

114 

65 

0.21 

0.98 

-0.18 

0.97 

-0.26 

0.40 

1.06 

1 

22 

50293 

1.53 

52 

14 

0.36 

0.88 

-0.60 

0.82 

-0.45 

0.56 

1.17 

1 

23 

5G115 

-0.04 

108 

82 

0.24 

0.95 

-0.43 

0.92 

-0.24 

0.37 

1.08 

1 

24 

5G49 

0.33 

205 

150 

0.17 

0.99 

-0.10 

0.99 

-0.01 

0.36 

1.02 

1 

25 

5G323 

0.75 

115 

83 

0.23 

0.98 

-0.14 

0.91 

-0.43 

0.42 

1.05 

1 

26 

51060 

-1.27 

47 

40 

0.44 

0.81 

-0.64 

0.54 

-0.84 

0.51 

1.21 

1 

27 

50549 

-0.28 

55 

37 

0.33 

1.05 

0.39 

1.07 

0.34 

0.43 

0.90 

1 

28 

50509 

-0.15 

55 

34 

0.31 

0.90 

-0.75 

0.81 

-0.91 

0.53 

1.27 

1 

29 

50143 

0.65 

64 

32 

0.29 

1.05 

0.46 

1.03 

0.19 

0.45 

0.89 

1 

30 

5MD56 

0.92 

210 

137 

0.16 

0.79 

-3.48 

0.68 

-3.18 

0.58 

1.53 
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Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

2 

1 

50A215 

0.13 

93 

74 

0.27 

0.97 

-0.16 

0.93 

-0.19 

0.34 

1.05 

2 

2 

50A112 

1.25 

112 

71 

0.21 

0.85 

-1.95 

0.80 

-1.76 

0.51 

1.46 

2 

3 

50A314 

1.56 

99 

53 

0.22 

0.97 

-0.29 

0.98 

-0.13 

0.43 

1.07 

2 

4 

50A315 

2.17 

95 

41 

0.22 

1.00 

0.02 

1.03 

0.32 

0.38 

0.98 

2 

5 

50308 

-0.75 

57 

43 

0.34 

0.91 

-0.47 

1.07 

0.31 

0.48 

1.09 

2 

6 

51056 

-0.50 

46 

29 

0.36 

0.97 

-0.14 

1.09 

0.43 

0.51 

0.99 

2 

7 

50761 

-0.29 

48 

29 

0.34 

0.73 

-2.18 

0.62 

-1.73 

0.63 

1.70 

2 

8 

50928 

-0.02 

49 

31 

0.34 

0.80 

-1.44 

0.88 

-0.43 

0.58 

1.38 

2 

9 

50336 

0.21 

52 

31 

0.31 

0.88 

-1.06 

0.88 

-0.57 

0.51 

1.32 

2 

10 

5NBT613 

0.44 

104 

77 

0.24 

0.98 

-0.12 

0.89 

-0.33 

0.38 

1.04 

2 

11 

50324 

1.24 

53 

23 

0.32 

0.85 

-1.08 

0.79 

-0.95 

0.61 

1.33 

2 

12 

50836 

-1.20 

49 

39 

0.40 

1.06 

0.33 

1.23 

0.59 

0.39 

0.92 

2 

13 

50691 

-0.48 

53 

36 

0.33 

0.99 

-0.01 

1.21 

0.76 

0.43 

0.94 

2 

14 

50539 

0.48 

289 

203 

0.14 

0.90 

-1.60 

0.84 

-1.17 

0.49 

1.19 

2 

15 

50507 

1.05 

53 

20 

0.32 

1.22 

1.53 

1.36 

1.57 

0.26 

0.47 

2 

16 

5NF43 

1.60 

96 

53 

0.22 

1.11 

1.37 

1.08 

0.79 

0.28 

0.65 

2 

17 

50552 

-1.93 

53 

46 

0.46 

1.01 

0.13 

0.61 

-0.47 

0.45 

1.06 

2 

18 

50869 

-1.06 

49 

39 

0.38 

0.98 

-0.04 

0.76 

-0.63 

0.39 

1.08 

2 

19 

50729 

-0.11 

48 

30 

0.33 

1.03 

0.27 

0.98 

0.01 

0.39 

0.94 

2 

20 

50111 

0.24 

52 

28 

0.32 

1.07 

0.58 

1.15 

0.78 

0.41 

0.78 

2 

21 

50403 

0.84 

50 

19 

0.32 

1.02 

0.19 

1.07 

0.44 

0.40 

0.92 

2 

22 

5MD122 

1.49 

112 

66 

0.21 

1.16 

1.78 

1.13 

1.03 

0.30 

0.62 

2 

23 

5G210 

0.05 

128 

100 

0.23 

0.88 

-0.99 

0.79 

-0.92 

0.39 

1.18 

2 

24 

5G41 

0.34 

98 

75 

0.25 

1.03 

0.25 

1.05 

0.32 

0.27 

0.94 

2 

25 

5G418 

0.86 

105 

70 

0.23 

0.98 

-0.13 

0.95 

-0.20 

0.40 

1.04 

2 

26 

50647 

-1.26 

54 

45 

0.39 

0.87 

-0.49 

0.94 

0.00 

0.43 

1.11 

2 

27 

50523 

-0.28 

55 

37 

0.32 

1.07 

0.56 

1.12 

0.50 

0.37 

0.82 

2 

28 

50816 

-0.15 

48 

30 

0.33 

1.00 

0.03 

0.95 

-0.11 

0.44 

1.02 

2 

29 

50337 

0.65 

53 

28 

0.31 

0.75 

-2.29 

0.71 

-2.07 

0.60 

1.76 

2 

30 

5MD412 

0.91 

105 

64 

0.21 

0.80 

-2.93 

0.74 

-2.28 

0.57 

1.71 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

3 

1 

50A222 

0.17 

93 

69 

0.25 

0.89 

-0.94 

0.73 

-1.35 

0.43 

1.25 

3 

2 

50A29 

1.27 

100 

59 

0.23 

1.09 

1.03 

1.19 

1.11 

0.34 

0.71 

3 

3 

50A227 

1.42 

97 

58 

0.23 

1.11 

1.23 

1.25 

1.38 

0.31 

0.65 

3 

4 

50A39 

2.13 

100 

42 

0.23 

1.10 

1.03 

1.08 

0.59 

0.39 

0.78 

3 

5 

51095 

-0.73 

56 

41 

0.35 

1.08 

0.49 

1.17 

0.57 

0.42 

0.86 

3 

6 

50047 

-0.49 

49 

33 

0.34 

0.85 

-1.00 

0.78 

-0.66 

0.52 

1.31 

3 

7 

50624 

-0.28 

51 

33 

0.33 

0.93 

-0.39 

0.99 

0.04 

0.50 

1.09 

3 

8 

50189 

-0.02 

51 

31 

0.31 

0.89 

-0.95 

0.79 

-1.24 

0.53 

1.36 

3 

9 

50639 

0.21 

49 

26 

0.33 

0.85 

-1.09 

0.92 

-0.30 

0.58 

1.29 

3 

10 

50759 

0.40 

48 

22 

0.32 

0.98 

-0.15 

0.92 

-0.45 

0.45 

1.11 

3 

11 

50021 

1.24 

63 

26 

0.30 

0.83 

-1.26 

0.77 

-1.13 

0.64 

1.32 

3 

12 

50974 

-1.09 

49 

40 

0.41 

0.93 

-0.20 

0.88 

-0.08 

0.46 

1.06 

3 

13 

50082 

-0.48 

51 

38 

0.36 

1.11 

0.67 

1.44 

1.06 

0.33 

0.75 

3 

14 

50543 

0.49 

60 

31 

0.30 

0.84 

-1.36 

0.76 

-1.24 

0.60 

1.40 

3 

15 

5NF311 

1.04 

94 

54 

0.23 

1.02 

0.30 

1.00 

0.05 

0.35 

0.94 

3 

16 

5NF46 

1.63 

97 

63 

0.24 

0.85 

-1.52 

0.72 

-1.59 

0.56 

1.37 

3 

17 

50272 

-1.89 

49 

42 

0.44 

1.04 

0.24 

0.85 

-0.15 

0.30 

0.99 

3 

18 

50556 

-1.13 

51 

37 

0.34 

1.19 

1.16 

1.44 

1.29 

0.19 

0.60 

3 

19 

51170 

-0.13 

55 

35 

0.33 

0.85 

-1.01 

0.68 

-1.16 

0.60 

1.33 

3 

20 

51156 

0.16 

51 

30 

0.32 

1.00 

0.06 

0.98 

-0.01 

0.47 

1.00 

3 

21 

5MD48 

0.73 

94 

60 

0.23 

0.95 

-0.59 

0.92 

-0.54 

0.40 

1.16 

3 

22 

51174 

1.40 

56 

21 

0.33 

0.92 

-0.49 

0.78 

-0.73 

0.60 

1.18 

3 

23 

5G27 

0.10 

224 

182 

0.18 

0.98 

-0.11 

1.05 

0.34 

0.31 

1.00 

3 

24 

5G225 

0.43 

126 

91 

0.21 

0.97 

-0.31 

1.23 

1.22 

0.29 

0.97 

3 

25 

5G312 

0.99 

125 

81 

0.20 

1.10 

1.23 

1.17 

0.96 

0.30 

0.71 

3 

26 

50155 

-1.26 

52 

42 

0.39 

0.85 

-0.65 

0.63 

-0.81 

0.51 

1.20 

3 

27 

5NF511 

-0.29 

226 

194 

0.20 

0.89 

-0.87 

0.65 

-1.81 

0.44 

1.14 

3 

28 

50994 

-0.15 

51 

32 

0.32 

1.10 

0.77 

1.05 

0.30 

0.37 

0.79 

3 

29 

50271 

0.66 

50 

19 

0.32 

1.06 

0.54 

1.05 

0.30 

0.35 

0.84 

3 

30 

51158 

1.00 

49 

20 

0.34 

0.90 

-0.65 

0.88 

-0.46 

0.50 

1.21 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

4 

1 

5OA230 

0.27 

93 

72 

0.26 

0.84 

-1.20 

0.71 

-1.33 

0.49 

1.26 

4 

2 

50A221 

1.20 

103 

66 

0.23 

1.02 

0.20 

0.94 

-0.35 

0.42 

1.00 

4 

3 

50A327 

1.62 

222 

119 

0.15 

1.02 

0.44 

1.08 

1.17 

0.36 

0.90 

4 

4 

50A33 

1.97 

95 

45 

0.22 

1.11 

1.44 

1.20 

1.85 

0.26 

0.56 

4 

5 

50931 

-0.71 

49 

33 

0.35 

1.03 

0.25 

0.90 

-0.27 

0.46 

0.99 

4 

6 

50314 

-0.48 

53 

34 

0.32 

1.04 

0.35 

1.07 

0.35 

0.39 

0.87 

4 

7 

50199 

-0.28 

54 

35 

0.32 

0.89 

-0.84 

0.81 

-0.64 

0.50 

1.28 

4 

8 

50935 

-0.01 

49 

29 

0.32 

1.14 

1.29 

1.24 

1.48 

0.24 

0.46 

4 

9 

50920 

0.21 

47 

23 

0.34 

1.00 

0.04 

0.90 

-0.37 

0.50 

1.05 

4 

10 

50758 

0.44 

49 

24 

0.32 

0.95 

-0.34 

0.95 

-0.25 

0.43 

1.13 

4 

11 

5NBT612 

1.23 

103 

56 

0.21 

1.00 

0.06 

0.97 

-0.28 

0.37 

1.02 

4 

12 

50527 

-1.16 

52 

41 

0.38 

0.93 

-0.24 

0.71 

-0.73 

0.50 

1.12 

4 

13 

50681 

-0.45 

50 

35 

0.36 

0.89 

-0.65 

0.73 

-0.61 

0.54 

1.22 

4 

14 

50053 

0.45 

61 

35 

0.30 

0.99 

-0.08 

0.85 

-0.68 

0.53 

1.10 

4 

15 

50809 

1.04 

47 

17 

0.36 

0.90 

-0.59 

0.81 

-0.70 

0.59 

1.20 

4 

16 

5NF319 

1.59 

97 

54 

0.22 

1.01 

0.14 

0.99 

-0.08 

0.38 

0.98 

4 

17 

50711 

-1.93 

50 

44 

0.47 

1.25 

0.84 

1.27 

0.62 

0.14 

0.80 

4 

18 

50126 

-1.17 

288 

262 

0.22 

1.04 

0.32 

1.00 

0.10 

0.29 

0.98 

4 

19 

50428 

-0.17 

53 

33 

0.32 

0.80 

-1.50 

0.69 

-1.42 

0.62 

1.45 

4 

20 

51172 

0.23 

50 

28 

0.32 

0.88 

-0.94 

0.77 

-1.09 

0.57 

1.34 

4 

21 

5MD411 

0.77 

95 

60 

0.23 

0.90 

-1.22 

0.82 

-1.33 

0.45 

1.34 

4 

22 

51164 

1.43 

67 

28 

0.28 

0.75 

-2.31 

0.65 

-2.15 

0.66 

1.60 

4 

23 

5G220 

0.14 

111 

88 

0.25 

0.88 

-0.83 

0.86 

-0.58 

0.45 

1.13 

4 

24 

5G320 

0.46 

101 

84 

0.29 

1.16 

0.97 

1.10 

0.40 

0.21 

0.83 

4 

25 

5G29 

0.97 

112 

71 

0.22 

1.00 

0.02 

0.90 

-0.48 

0.45 

1.04 

4 

26 

50302 

-1.26 

51 

39 

0.37 

0.78 

-1.15 

0.76 

-0.62 

0.55 

1.27 

4 

27 

50492 

-0.32 

49 

33 

0.35 

1.22 

1.32 

1.18 

0.73 

0.31 

0.65 

4 

28 

50355 

-0.17 

51 

32 

0.32 

0.99 

-0.06 

0.95 

-0.18 

0.44 

1.05 

4 

29 

5MD45 

0.67 

124 

84 

0.20 

0.99 

-0.04 

0.93 

-0.39 

0.33 

1.04 

4 

30 

51046 

1.03 

47 

19 

0.34 

0.89 

-0.69 

0.90 

-0.40 

0.55 

1.21 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

5 

1 

50A323 

0.33 

100 

76 

0.25 

1.07 

0.60 

1.35 

1.19 

0.26 

0.82 

5 

2 

50A318 

1.22 

97 

70 

0.25 

0.86 

-1.22 

0.72 

-1.22 

0.52 

1.27 

5 

3 

50A223 

1.62 

100 

46 

0.22 

0.94 

-0.76 

0.92 

-0.79 

0.44 

1.22 

5 

4 

5OA310 

2.00 

222 

86 

0.15 

1.04 

0.71 

1.12 

1.22 

0.39 

0.86 

5 

5 

50164 

-0.69 

51 

39 

0.36 

0.97 

-0.11 

0.84 

-0.34 

0.39 

1.07 

5 

6 

5NBT314 

-0.48 

103 

85 

0.27 

0.96 

-0.22 

0.83 

-0.45 

0.34 

1.06 

5 

7 

50025 

-0.24 

64 

43 

0.31 

0.92 

-0.57 

0.76 

-0.74 

0.55 

1.18 

5 

8 

50796 

-0.03 

49 

30 

0.33 

0.92 

-0.58 

1.06 

0.34 

0.46 

1.11 

5 

9 

5NBT514 

0.18 

109 

88 

0.26 

0.87 

-0.86 

0.64 

-1.39 

0.49 

1.20 

5 

10 

5NBT22 

0.41 

124 

90 

0.21 

0.95 

-0.51 

0.80 

-1.06 

0.37 

1.16 

5 

11 

50918 

1.18 

49 

18 

0.34 

0.87 

-0.80 

0.74 

-1.16 

0.59 

1.28 

5 

12 

50665 

-1.14 

52 

42 

0.37 

0.93 

-0.30 

0.83 

-0.31 

0.34 

1.11 

5 

13 

50080 

-0.45 

51 

36 

0.33 

1.09 

0.59 

0.99 

0.03 

0.31 

0.89 

5 

14 

50381 

0.50 

55 

27 

0.30 

1.10 

0.94 

1.06 

0.42 

0.34 

0.72 

5 

15 

50529 

1.08 

50 

18 

0.32 

0.95 

-0.33 

0.85 

-0.76 

0.45 

1.18 

5 

16 

5NF34 

1.58 

99 

44 

0.23 

0.96 

-0.45 

1.21 

1.64 

0.44 

1.02 

5 

17 

50280 

-1.86 

269 

253 

0.27 

0.89 

-0.45 

0.53 

-1.38 

0.33 

1.09 

5 

18 

50573 

-1.14 

52 

41 

0.37 

0.93 

-0.29 

0.77 

-0.43 

0.43 

1.12 

5 

19 

51171 

-0.06 

274 

201 

0.15 

1.01 

0.15 

0.91 

-0.50 

0.37 

1.01 

5 

20 

50139 

0.21 

50 

27 

0.32 

0.89 

-0.88 

0.85 

-0.72 

0.54 

1.29 

5 

21 

5MD58 

0.80 

95 

46 

0.22 

0.89 

-1.70 

0.86 

-1.61 

0.47 

1.55 

5 

22 

5MD214 

1.44 

95 

33 

0.23 

1.03 

0.36 

1.11 

0.93 

0.27 

0.87 

5 

23 

5G25 

-0.18 

115 

98 

0.28 

1.04 

0.26 

1.06 

0.28 

0.28 

0.95 

5 

24 

5G121 

0.54 

104 

69 

0.23 

1.05 

0.56 

1.07 

0.49 

0.34 

0.87 

5 

25 

5G424 

0.88 

113 

79 

0.22 

0.92 

-0.79 

0.83 

-1.13 

0.45 

1.19 

5 

26 

50309 

-1.26 

53 

43 

0.38 

0.95 

-0.15 

0.79 

-0.48 

0.39 

1.09 

5 

27 

50400 

-0.33 

52 

33 

0.32 

0.97 

-0.19 

0.94 

-0.26 

0.47 

1.08 

5 

28 

50368 

-0.18 

52 

34 

0.32 

1.00 

0.04 

0.87 

-0.52 

0.45 

1.06 

5 

29 

5MD211 

0.67 

105 

69 

0.22 

1.03 

0.38 

0.99 

-0.05 

0.31 

0.94 

5 

30 

5MD116 

0.93 

112 

77 

0.22 

1.05 

0.55 

1.06 

0.43 

0.30 

0.89 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

6 

1 

50A125 

0.36 

100 

72 

0.24 

0.91 

-0.85 

0.78 

-1.23 

0.43 

1.23 

6 

2 

50A25 

1.19 

116 

63 

0.20 

0.92 

-1.12 

0.88 

-1.10 

0.46 

1.29 

6 

3 

5OA320 

1.50 

103 

60 

0.22 

1.13 

1.40 

1.09 

0.68 

0.34 

0.70 

6 

4 

50A134 

2.01 

97 

56 

0.23 

1.03 

0.31 

0.94 

-0.32 

0.44 

0.98 

6 

5 

50792 

-0.71 

48 

34 

0.35 

0.97 

-0.18 

0.84 

-0.40 

0.42 

1.10 

6 

6 

50937 

-0.47 

48 

29 

0.34 

1.00 

0.06 

0.90 

-0.33 

0.46 

1.04 

6 

7 

51075 

-0.29 

49 

30 

0.33 

1.03 

0.31 

1.08 

0.42 

0.37 

0.89 

6 

8 

50013 

-0.03 

2813 

1689 

0.04 

0.93 

-4.33 

0.89 

-3.69 

0.50 

1.19 

6 

9 

50338 

0.18 

52 

30 

0.32 

0.84 

-1.25 

0.97 

-0.05 

0.56 

1.32 

6 

10 

51071 

0.44 

50 

25 

0.33 

0.81 

-1.45 

0.71 

-1.33 

0.62 

1.47 

6 

11 

50473 

1.18 

60 

22 

0.31 

0.93 

-0.46 

0.83 

-0.66 

0.54 

1.16 

6 

12 

50398 

-1.10 

52 

41 

0.36 

0.93 

-0.30 

1.03 

0.19 

0.38 

1.06 

6 

13 

50229 

-0.43 

48 

31 

0.34 

0.78 

-1.53 

0.87 

-0.55 

0.57 

1.39 

6 

14 

50672 

0.44 

50 

24 

0.30 

0.88 

-1.34 

0.88 

-1.04 

0.49 

1.53 

6 

15 

50807 

1.06 

48 

18 

0.34 

0.79 

-1.38 

0.80 

-0.86 

0.62 

1.38 

6 

16 

5NF47 

1.53 

123 

61 

0.20 

0.86 

-2.31 

0.81 

-1.93 

0.50 

1.59 

6 

17 

50437 

-1.88 

54 

46 

0.42 

0.86 

-0.47 

0.63 

-0.71 

0.48 

1.15 

6 

18 

50401 

-1.18 

54 

43 

0.36 

1.16 

0.83 

1.18 

0.50 

0.21 

0.77 

6 

19 

50431 

-0.10 

295 

229 

0.16 

0.88 

-1.51 

0.70 

-2.00 

0.50 

1.19 

6 

20 

5MD47 

0.18 

109 

88 

0.26 

0.85 

-1.04 

0.61 

-1.51 

0.51 

1.22 

6 

21 

5MD117 

0.78 

97 

67 

0.23 

1.02 

0.28 

0.99 

-0.03 

0.33 

0.96 

6 

22 

5MD113 

1.45 

111 

63 

0.21 

1.13 

1.70 

1.13 

0.90 

0.31 

0.60 

6 

23 

5G419 

0.15 

213 

143 

0.16 

1.01 

0.16 

1.01 

0.11 

0.33 

0.97 

6 

24 

5G321 

0.54 

125 

88 

0.21 

1.05 

0.58 

1.08 

0.53 

0.26 

0.87 

6 

25 

5G45 

0.83 

124 

80 

0.20 

1.08 

1.09 

1.07 

0.52 

0.26 

0.76 

6 

26 

51054 

-1.26 

52 

40 

0.38 

0.99 

0.00 

0.79 

-0.31 

0.48 

1.06 

6 

27 

50550 

-0.34 

50 

31 

0.32 

0.96 

-0.28 

0.83 

-0.65 

0.44 

1.18 

6 

28 

50383 

-0.11 

50 

32 

0.33 

0.93 

-0.54 

0.75 

-0.95 

0.52 

1.25 

6 

29 

51031 

0.59 

50 

21 

0.32 

0.97 

-0.19 

1.01 

0.12 

0.44 

1.05 

6 

30 

5MD52 

1.05 

121 

69 

0.20 

0.72 

-4.23 

0.67 

-3.27 

0.61 

1.90 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

7 

1 

50A324 

0.37 

111 

74 

0.22 

0.87 

-1.51 

0.78 

-1.62 

0.49 

1.34 

7 

2 

50A317 

1.19 

99 

52 

0.22 

0.95 

-0.54 

1.01 

0.12 

0.45 

1.10 

7 

3 

50A37 

1.48 

93 

45 

0.23 

1.08 

0.96 

1.05 

0.53 

0.33 

0.76 

7 

4 

50A124 

1.90 

93 

37 

0.23 

1.07 

0.81 

1.09 

0.79 

0.34 

0.79 

7 

5 

50793 

-0.67 

49 

34 

0.35 

1.04 

0.28 

0.95 

-0.03 

0.42 

0.96 

7 

6 

50195 

-0.46 

52 

33 

0.33 

1.00 

0.02 

0.98 

0.00 

0.46 

1.01 

7 

7 

50315 

-0.23 

52 

33 

0.32 

0.84 

-1.28 

0.74 

-1.29 

0.55 

1.44 

7 

8 

50176 

-0.03 

54 

30 

0.30 

0.98 

-0.16 

0.99 

0.02 

0.43 

1.05 

7 

9 

50925 

0.18 

49 

27 

0.32 

1.01 

0.16 

0.97 

-0.09 

0.45 

0.98 

7 

10 

5NBT212 

0.45 

103 

79 

0.25 

0.99 

-0.03 

0.99 

0.04 

0.34 

1.01 

7 

11 

50789 

1.17 

49 

16 

0.33 

1.11 

0.80 

1.35 

1.22 

0.25 

0.68 

7 

12 

50230 

-1.19 

50 

41 

0.39 

1.07 

0.36 

1.30 

0.85 

0.24 

0.90 

7 

13 

50513 

-0.50 

53 

36 

0.33 

0.82 

-1.26 

0.71 

-0.97 

0.56 

1.37 

7 

14 

50678 

0.44 

48 

25 

0.32 

1.03 

0.29 

1.00 

0.06 

0.43 

0.93 

7 

15 

5NF67 

1.07 

93 

53 

0.23 

0.99 

-0.14 

0.95 

-0.39 

0.39 

1.07 

7 

16 

5NF53 

1.63 

97 

63 

0.24 

1.10 

1.05 

1.16 

0.86 

0.34 

0.75 

7 

17 

50259 

-1.80 

52 

44 

0.41 

1.01 

0.13 

1.06 

0.27 

0.27 

0.97 

7 

18 

50424 

-1.18 

50 

39 

0.38 

1.06 

0.35 

0.98 

0.10 

0.38 

0.94 

7 

19 

50893 

-0.06 

49 

27 

0.32 

0.91 

-0.80 

0.87 

-0.56 

0.50 

1.29 

7 

20 

51013 

0.29 

54 

33 

0.31 

0.97 

-0.21 

0.91 

-0.40 

0.45 

1.10 

7 

21 

51178 

0.83 

48 

23 

0.33 

0.80 

-1.56 

0.70 

-1.47 

0.61 

1.54 

7 

22 

51193 

1.45 

56 

17 

0.33 

1.10 

0.63 

1.20 

0.85 

0.37 

0.84 

7 

23 

5G222 

-0.16 

98 

82 

0.29 

1.04 

0.26 

1.10 

0.44 

0.22 

0.95 

7 

24 

5G322 

0.52 

125 

84 

0.21 

0.91 

-1.11 

0.87 

-0.82 

0.44 

1.22 

7 

25 

5G221 

0.98 

122 

83 

0.21 

0.98 

-0.19 

0.98 

-0.10 

0.37 

1.04 

7 

26 

50617 

-1.25 

52 

39 

0.37 

0.77 

-1.28 

0.55 

-1.34 

0.61 

1.37 

7 

27 

50219 

-0.35 

60 

40 

0.32 

1.01 

0.10 

0.91 

-0.30 

0.48 

1.02 

7 

28 

51000 

-0.13 

63 

45 

0.32 

0.94 

-0.33 

0.80 

-0.65 

0.50 

1.14 

7 

29 

51010 

0.60 

52 

26 

0.31 

1.15 

1.21 

1.12 

0.52 

0.36 

0.63 

7 

30 

5MD415 

1.00 

95 

42 

0.22 

0.91 

-1.28 

0.88 

-1.31 

0.44 

1.40 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

8 

1 

50A319 

0.41 

118 

85 

0.22 

0.90 

-1.05 

0.79 

-1.11 

0.40 

1.24 

8 

2 

50A28 

1.15 

100 

56 

0.22 

0.99 

-0.10 

0.96 

-0.33 

0.37 

1.05 

8 

3 

50A126 

1.64 

101 

52 

0.22 

1.06 

0.77 

1.22 

1.49 

0.38 

0.77 

8 

4 

50A213 

1.90 

99 

46 

0.22 

1.27 

3.07 

1.32 

2.73 

0.14 

0.13 

8 

5 

50772 

-0.70 

49 

32 

0.34 

1.04 

0.32 

0.99 

0.06 

0.42 

0.94 

8 

6 

50014 

-0.50 

58 

39 

0.32 

0.97 

-0.17 

0.93 

-0.15 

0.46 

1.06 

8 

7 

50033 

-0.29 

50 

31 

0.34 

0.71 

-1.95 

0.61 

-1.72 

0.68 

1.53 

8 

8 

5NBT52 

-0.02 

95 

63 

0.23 

0.87 

-1.54 

0.82 

-1.36 

0.46 

1.39 

8 

9 

5NBT320 

0.19 

104 

81 

0.25 

0.88 

-0.92 

0.77 

-0.72 

0.43 

1.18 

8 

10 

50046 

0.43 

50 

25 

0.33 

0.95 

-0.34 

0.92 

-0.35 

0.52 

1.13 

8 

11 

5NBT34 

1.14 

95 

39 

0.22 

1.01 

0.11 

1.00 

0.03 

0.33 

0.98 

8 

12 

50228 

-1.16 

50 

40 

0.38 

0.90 

-0.41 

0.81 

-0.48 

0.45 

1.13 

8 

13 

50353 

-0.52 

51 

34 

0.34 

1.04 

0.31 

1.02 

0.14 

0.43 

0.93 

8 

14 

50378 

0.51 

52 

26 

0.31 

0.88 

-1.08 

0.80 

-1.23 

0.55 

1.40 

8 

15 

50997 

1.03 

49 

19 

0.33 

1.03 

0.24 

0.98 

-0.05 

0.42 

0.96 

8 

16 

5NF411 

1.59 

112 

47 

0.21 

1.06 

0.75 

1.06 

0.61 

0.35 

0.83 

8 

17 

50252 

-1.86 

57 

49 

0.42 

0.80 

-0.72 

0.56 

-0.79 

0.52 

1.19 

8 

18 

50466 

-1.02 

58 

45 

0.34 

0.81 

-1.08 

0.68 

-0.89 

0.52 

1.27 

8 

19 

50416 

-0.04 

297 

222 

0.15 

1.00 

0.02 

0.92 

-0.52 

0.38 

1.02 

8 

20 

50890 

0.25 

49 

28 

0.35 

0.85 

-1.05 

0.70 

-1.17 

0.62 

1.38 

8 

21 

51167 

0.74 

48 

24 

0.34 

0.99 

-0.04 

1.00 

0.06 

0.49 

1.01 

8 

22 

51195 

1.39 

48 

15 

0.36 

1.25 

1.30 

1.47 

1.52 

0.32 

0.60 

8 

23 

5G34 

-0.15 

125 

95 

0.22 

1.03 

0.33 

1.11 

0.63 

0.28 

0.92 

8 

24 

5G316 

0.51 

110 

81 

0.23 

0.86 

-1.23 

0.81 

-1.07 

0.51 

1.23 

8 

25 

5G33 

1.02 

110 

69 

0.22 

0.87 

-1.47 

0.82 

-1.02 

0.52 

1.32 

8 

26 

50017 

-1.25 

55 

45 

0.39 

0.83 

-0.80 

0.68 

-0.51 

0.50 

1.21 

8 

27 

50828 

-0.35 

47 

30 

0.35 

0.87 

-0.89 

0.95 

-0.17 

0.51 

1.22 

8 

28 

50998 

-0.13 

51 

33 

0.34 

0.93 

-0.41 

0.82 

-0.52 

0.52 

1.17 

8 

29 

50413 

0.62 

50 

23 

0.33 

1.12 

0.83 

1.08 

0.45 

0.42 

0.77 

8 

30 

5MD29 

1.03 

124 

75 

0.20 

0.90 

-1.62 

0.84 

-1.24 

0.44 

1.40 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

9 

1 

50A216 

0.42 

99 

67 

0.23 

1.00 

0.04 

0.90 

-0.44 

0.38 

1.04 

9 

2 

50A228 

1.08 

111 

74 

0.21 

0.96 

-0.41 

0.99 

0.00 

0.36 

1.06 

9 

3 

50A117 

1.46 

93 

51 

0.23 

0.99 

-0.05 

0.95 

-0.45 

0.40 

1.06 

9 

4 

50A232 

1.90 

99 

38 

0.23 

1.21 

1.95 

1.22 

1.57 

0.27 

0.56 

9 

5 

50625 

-0.75 

53 

37 

0.35 

0.79 

-1.32 

0.70 

-0.86 

0.60 

1.34 

9 

6 

50785 

-0.46 

49 

31 

0.33 

0.72 

-2.27 

0.59 

-1.85 

0.66 

1.67 

9 

7 

50913 

-0.26 

49 

33 

0.35 

1.01 

0.14 

0.94 

-0.12 

0.46 

1.00 

9 

8 

50902 

0.00 

49 

29 

0.32 

1.09 

0.80 

1.08 

0.44 

0.33 

0.72 

9 

9 

5NBT513 

0.23 

118 

86 

0.22 

0.90 

-0.98 

0.79 

-1.16 

0.42 

1.22 

9 

10 

50921 

0.46 

49 

24 

0.31 

1.09 

0.92 

1.15 

1.17 

0.24 

0.57 

9 

11 

5NBT516 

1.14 

103 

58 

0.21 

0.87 

-1.86 

0.83 

-1.63 

0.50 

1.51 

9 

12 

50241 

-1.17 

50 

41 

0.41 

0.81 

-0.84 

0.61 

-0.71 

0.48 

1.26 

9 

13 

50493 

-0.51 

46 

32 

0.36 

0.94 

-0.30 

0.83 

-0.52 

0.48 

1.13 

9 

14 

50653 

0.49 

51 

24 

0.32 

1.30 

2.04 

1.23 

0.98 

0.31 

0.39 

9 

15 

50684 

1.09 

50 

19 

0.33 

0.97 

-0.16 

1.02 

0.18 

0.46 

1.02 

9 

16 

5NF316 

1.52 

99 

57 

0.23 

0.84 

-1.99 

0.81 

-1.21 

0.55 

1.45 

9 

17 

50599 

-1.89 

49 

40 

0.42 

0.62 

-1.59 

0.53 

-1.24 

0.66 

1.35 

9 

18 

50879 

-1.07 

49 

39 

0.38 

0.77 

-1.22 

0.58 

-0.92 

0.51 

1.33 

9 

19 

51168 

-0.02 

282 

225 

0.16 

0.84 

-1.90 

0.68 

-2.28 

0.51 

1.22 

9 

20 

50587 

0.28 

50 

26 

0.33 

0.82 

-1.37 

0.75 

-1.14 

0.61 

1.43 

9 

21 

5MD41 

0.88 

121 

73 

0.20 

0.91 

-1.27 

0.85 

-1.24 

0.46 

1.31 

9 

22 

5MD121 

1.52 

122 

58 

0.20 

1.07 

0.92 

1.06 

0.62 

0.36 

0.80 

9 

23 

5G417 

-0.10 

248 

197 

0.17 

0.95 

-0.57 

1.11 

0.68 

0.32 

1.06 

9 

24 

5G315 

0.51 

225 

171 

0.17 

0.91 

-1.07 

0.81 

-1.06 

0.42 

1.16 

9 

25 

5G120 

0.90 

115 

80 

0.22 

1.02 

0.21 

0.91 

-0.49 

0.41 

1.01 

9 

26 

50192 

-1.24 

58 

48 

0.38 

0.99 

0.02 

0.89 

-0.08 

0.36 

1.02 

9 

27 

50373 

-0.35 

52 

33 

0.33 

1.02 

0.17 

0.92 

-0.25 

0.48 

1.01 

9 

28 

50680 

-0.13 

49 

30 

0.34 

0.97 

-0.16 

0.90 

-0.33 

0.51 

1.09 

9 

29 

51029 

0.62 

56 

28 

0.30 

0.96 

-0.35 

0.90 

-0.62 

0.48 

1.16 

9 

30 

5MD518 

1.08 

98 

73 

0.25 

0.88 

-0.96 

0.68 

-1.33 

0.51 

1.24 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

10 

1 

50A128 

0.43 

94 

53 

0.22 

0.92 

-1.29 

0.88 

-1.16 

0.43 

1.42 

10 

2 

50A32 

1.07 

116 

66 

0.20 

1.23 

3.01 

1.26 

2.18 

0.19 

0.21 

10 

3 

5OA120 

1.65 

118 

55 

0.20 

1.19 

2.69 

1.23 

2.15 

0.19 

0.24 

10 

4 

50A233 

1.91 

97 

58 

0.23 

0.96 

-0.36 

0.89 

-0.63 

0.48 

1.11 

10 

5 

50197 

-0.74 

49 

35 

0.35 

1.00 

0.06 

0.79 

-0.56 

0.45 

1.07 

10 

6 

5NBT18 

-0.46 

113 

91 

0.25 

0.90 

-0.72 

0.79 

-0.85 

0.41 

1.14 

10 

7 

50924 

-0.22 

266 

191 

0.15 

0.96 

-0.64 

0.88 

-1.07 

0.40 

1.10 

10 

8 

50003 

0.01 

62 

40 

0.31 

1.19 

1.30 

1.15 

0.67 

0.39 

0.69 

10 

9 

51085 

0.23 

58 

35 

0.30 

0.89 

-0.87 

0.91 

-0.43 

0.53 

1.24 

10 

10 

50339 

0.47 

49 

26 

0.33 

0.89 

-0.86 

0.97 

-0.09 

0.53 

1.23 

10 

11 

5NBT413 

1.12 

119 

66 

0.20 

0.97 

-0.37 

0.94 

-0.53 

0.41 

1.11 

10 

12 

50076 

-1.08 

51 

40 

0.37 

1.03 

0.22 

1.18 

0.53 

0.32 

0.92 

10 

13 

50357 

-0.53 

55 

41 

0.34 

1.07 

0.45 

0.93 

-0.13 

0.34 

0.94 

10 

14 

50690 

0.51 

50 

25 

0.34 

1.17 

1.15 

1.13 

0.46 

0.46 

0.68 

10 

15 

5NF48 

1.07 

116 

66 

0.20 

0.90 

-1.44 

0.84 

-1.46 

0.47 

1.38 

10 

16 

5NF45 

1.53 

99 

45 

0.22 

1.10 

1.14 

1.07 

0.60 

0.36 

0.75 

10 

17 

50129 

-1.94 

51 

45 

0.45 

1.11 

0.45 

1.50 

0.97 

0.05 

0.85 

10 

18 

50590 

-1.04 

48 

36 

0.36 

0.77 

-1.28 

0.69 

-1.02 

0.58 

1.34 

10 

19 

50745 

-0.09 

49 

29 

0.32 

0.97 

-0.23 

0.95 

-0.22 

0.43 

1.10 

10 

20 

50409 

0.18 

49 

28 

0.33 

1.02 

0.23 

1.01 

0.09 

0.44 

0.94 

10 

21 

50449 

0.75 

59 

28 

0.30 

1.07 

0.57 

1.06 

0.40 

0.43 

0.85 

10 

22 

5MD42 

1.39 

109 

65 

0.21 

0.86 

-1.91 

0.80 

-1.84 

0.53 

1.46 

10 

23 

5G119 

-0.05 

213 

151 

0.16 

0.97 

-0.35 

0.88 

-1.04 

0.37 

1.09 

10 

24 

5G23 

0.48 

125 

85 

0.21 

0.95 

-0.53 

0.84 

-1.03 

0.42 

1.16 

10 

25 

5G17 

1.02 

123 

83 

0.21 

1.13 

1.51 

1.06 

0.51 

0.24 

0.74 

10 

26 

5NBT214 

-1.21 

103 

93 

0.34 

0.90 

-0.35 

0.60 

-0.84 

0.34 

1.11 

10 

27 

50848 

-0.38 

51 

34 

0.32 

1.08 

0.61 

1.11 

0.53 

0.32 

0.79 

10 

28 

50222 

-0.13 

55 

33 

0.31 

0.89 

-0.87 

0.79 

-1.10 

0.54 

1.32 

10 

29 

50430 

0.64 

66 

34 

0.28 

1.02 

0.19 

0.94 

-0.25 

0.47 

1.00 

10 

30 

51027 

1.06 

58 

23 

0.30 

0.93 

-0.57 

0.92 

-0.40 

0.52 

1.17 



easyCBM CCSS Fifth Grade Math Measure Development 


82 

Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMF 

1 

50A212 

0.41 

111 

87 

0.24 

0.85 

-1.15 

0.71 

-1.50 

0.48 

1.23 

BMF 

2 

50A38 

1.29 

100 

53 

0.22 

1.08 

1.14 

1.09 

0.84 

0.28 

0.67 

BMF 

3 

50A22 

1.52 

205 

98 

0.15 

0.95 

-0.88 

0.93 

-1.01 

0.43 

1.18 

BMF 

4 

5OA130 

2.10 

99 

42 

0.22 

1.08 

1.01 

1.11 

0.98 

0.32 

0.74 

BMF 

5 

50311 

-0.72 

48 

33 

0.36 

0.92 

-0.43 

0.72 

-0.83 

0.57 

1.19 

BMF 

6 

5NBT517 

-0.48 

104 

90 

0.30 

0.92 

-0.39 

0.74 

-0.50 

0.34 

1.09 

BMF 

7 

50914 

-0.25 

48 

33 

0.36 

0.94 

-0.40 

1.46 

1.30 

0.46 

1.03 

BMF 

8 

50183 

-0.03 

56 

33 

0.30 

0.75 

-2.28 

0.66 

-1.71 

0.61 

1.70 

BMF 

9 

5NBT55 

0.20 

99 

80 

0.27 

0.96 

-0.22 

0.99 

0.04 

0.34 

1.04 

BMF 

10 

5NBT518 

0.42 

237 

174 

0.16 

0.94 

-0.73 

0.93 

-0.48 

0.41 

1.10 

BMF 

11 

5NBT512 

1.18 

124 

71 

0.20 

1.04 

0.67 

1.01 

0.15 

0.32 

0.86 

BMF 

12 

50999 

-1.15 

49 

38 

0.37 

0.87 

-0.63 

0.84 

-0.29 

0.47 

1.16 

BMF 

13 

50696 

-0.47 

50 

33 

0.33 

0.93 

-0.52 

0.83 

-0.56 

0.47 

1.20 

BMF 

14 

5NF33 

0.46 

94 

70 

0.25 

0.87 

-1.09 

0.74 

-1.38 

0.48 

1.26 

BMF 

15 

5NF213 

1.08 

104 

65 

0.22 

0.98 

-0.21 

0.98 

-0.07 

0.42 

1.05 

BMF 

16 

5NF611 

1.55 

98 

56 

0.23 

0.93 

-0.83 

0.84 

-1.01 

0.49 

1.25 

BMF 

17 

50595 

-1.84 

53 

45 

0.42 

0.94 

-0.16 

1.03 

0.24 

0.35 

1.03 

BMF 

18 

50885 

-1.11 

49 

38 

0.37 

1.00 

0.08 

0.92 

-0.04 

0.38 

1.00 

BMF 

19 

51017 

-0.08 

51 

31 

0.31 

1.01 

0.08 

1.02 

0.19 

0.40 

0.97 

BMF 

20 

50733 

0.22 

48 

26 

0.32 

1.04 

0.38 

1.00 

0.07 

0.42 

0.92 

BMF 

21 

5MD414 

0.79 

115 

67 

0.21 

0.99 

-0.16 

0.97 

-0.20 

0.40 

1.05 

BMF 

22 

51050 

1.43 

53 

19 

0.32 

0.88 

-0.79 

1.04 

0.28 

0.52 

1.17 

BMF 

23 

5G410 

-0.01 

107 

81 

0.24 

0.85 

-1.36 

0.68 

-1.39 

0.48 

1.29 

BMF 

24 

5G310 

0.39 

125 

83 

0.20 

0.94 

-0.74 

0.87 

-1.00 

0.43 

1.18 

BMF 

25 

5G46 

0.96 

122 

72 

0.20 

1.02 

0.28 

1.00 

0.00 

0.37 

0.95 

BMF 

26 

50A34 

-1.24 

237 

219 

0.25 

0.95 

-0.22 

0.75 

-0.64 

0.27 

1.05 

BMF 

27 

5NBT25 

-0.33 

94 

77 

0.28 

0.85 

-0.94 

0.62 

-1.49 

0.44 

1.22 

BMF 

28 

50A11 

-0.15 

112 

85 

0.24 

0.82 

-1.59 

0.76 

-1.25 

0.49 

1.28 

BMF 

29 

5G412 

0.63 

124 

85 

0.21 

0.98 

-0.20 

0.89 

-0.64 

0.34 

1.09 

BMF 

30 

5MD415 

1.00 

95 

42 

0.22 

0.91 

-1.28 

0.88 

-1.31 

0.44 

1.40 


Note. BMF = Benchmark Fall. 



easyCBM CCSS Fifth Grade Math Measure Development 


83 

Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMF 

31 

I6NS701 1 

-1.93 

163 

138 

0.22 

0.93 

-0.48 

0.83 

-0.91 

0.34 

1.09 

BMF 

32 

I6NS5015 

-0.43 

300 

162 

0.12 

0.97 

-0.81 

0.94 

-1.21 

0.36 

1.18 

BMF 

33 

I6NS5006 

0.01 

193 

79 

0.15 

0.93 

-1.42 

0.92 

-1.45 

0.39 

1.32 

BMF 

34 

I6RP1023 

0.12 

163 

76 

0.16 

0.98 

-0.51 

1.00 

-0.07 

0.33 

1.10 

BMF 

35 

I6EE2010 

1.11 

199 

51 

0.17 

1.06 

0.74 

1.06 

0.54 

0.27 

0.91 

BMF 

36 

41093 

-0.89 

46 

36 

0.39 

0.74 

-1.34 

0.52 

-1.22 

0.61 

1.37 

BMF 

37 

40A416 

-0.41 

119 

99 

0.26 

0.85 

-1.01 

0.59 

-1.32 

0.46 

1.20 

BMF 

38 

4G330 

0.42 

89 

65 

0.26 

0.95 

-0.40 

0.86 

-0.64 

0.40 

1.12 

BMF 

39 

40A29 

0.98 

92 

57 

0.23 

0.85 

-1.84 

0.83 

-1.20 

0.51 

1.44 

BMF 

40 

40A57 

1.55 

89 

50 

0.23 

0.95 

-0.61 

0.92 

-0.67 

0.42 

1.20 


Note. BMF = Benchmark Fall. 



easyCBM CCSS Fifth Grade Math Measure Development 


84 

Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMW 

1 

5OA220 

0.41 

116 

81 

0.22 

1.01 

0.13 

0.97 

-0.12 

0.33 

0.99 

BMW 

2 

50A217 

1.28 

97 

69 

0.25 

1.02 

0.24 

1.12 

0.56 

0.37 

0.92 

BMW 

3 

50A115 

1.53 

205 

102 

0.15 

0.96 

-0.72 

0.92 

-0.96 

0.46 

1.15 

BMW 

4 

50A326 

2.10 

97 

45 

0.23 

1.05 

0.55 

1.03 

0.23 

0.42 

0.89 

BMW 

5 

50474 

-0.72 

61 

44 

0.32 

1.01 

0.12 

0.82 

-0.47 

0.45 

1.04 

BMW 

6 

5NBT517 

-0.48 

104 

90 

0.30 

0.92 

-0.39 

0.74 

-0.50 

0.34 

1.09 

BMW 

7 

51074 

-0.25 

50 

33 

0.35 

0.95 

-0.27 

0.88 

-0.38 

0.51 

1.12 

BMW 

8 

50179 

-0.03 

54 

34 

0.32 

0.79 

-1.61 

0.69 

-1.42 

0.61 

1.47 

BMW 

9 

50004 

0.20 

52 

25 

0.30 

1.03 

0.32 

0.98 

-0.07 

0.39 

0.93 

BMW 

10 

5NBT518 

0.42 

237 

174 

0.16 

0.94 

-0.73 

0.93 

-0.48 

0.41 

1.10 

BMW 

11 

5NBT33 

1.18 

113 

57 

0.21 

0.95 

-0.62 

0.99 

-0.11 

0.43 

1.13 

BMW 

12 

50542 

-1.15 

49 

38 

0.37 

0.90 

-0.48 

0.94 

-0.06 

0.41 

1.11 

BMW 

13 

50232 

-0.46 

51 

37 

0.35 

0.83 

-1.06 

0.83 

-0.41 

0.52 

1.26 

BMW 

14 

5NF65 

0.45 

116 

80 

0.22 

0.94 

-0.62 

0.86 

-0.85 

0.40 

1.16 

BMW 

15 

5NF213 

1.08 

104 

65 

0.22 

0.98 

-0.21 

0.98 

-0.07 

0.42 

1.05 

BMW 

16 

5NF210 

1.55 

108 

62 

0.22 

0.72 

-3.68 

0.72 

-2.32 

0.66 

1.72 

BMW 

17 

50595 

-1.84 

53 

45 

0.42 

0.94 

-0.16 

1.03 

0.24 

0.35 

1.03 

BMW 

18 

50422 

-1.11 

51 

39 

0.36 

1.06 

0.38 

0.89 

-0.16 

0.35 

0.96 

BMW 

19 

51019 

-0.08 

55 

36 

0.32 

1.03 

0.25 

0.89 

-0.35 

0.43 

1.00 

BMW 

20 

5MD46 

0.22 

121 

88 

0.22 

0.89 

-1.12 

0.79 

-1.19 

0.43 

1.24 

BMW 

21 

5MD414 

0.79 

115 

67 

0.21 

0.99 

-0.16 

0.97 

-0.20 

0.40 

1.05 

BMW 

22 

50148 

1.43 

56 

21 

0.32 

0.96 

-0.21 

1.05 

0.28 

0.46 

1.03 

BMW 

23 

5G26 

0.01 

100 

77 

0.25 

0.96 

-0.28 

0.81 

-0.85 

0.36 

1.10 

BMW 

24 

5G47 

0.39 

113 

88 

0.25 

0.75 

-2.05 

0.57 

-2.03 

0.59 

1.36 

BMW 

25 

5G416 

0.95 

106 

64 

0.21 

0.94 

-0.80 

1.18 

1.47 

0.39 

1.12 

BMW 

26 

50192 

-1.24 

58 

48 

0.38 

0.99 

0.02 

0.89 

-0.08 

0.36 

1.02 

BMW 

27 

50109 

-0.33 

52 

33 

0.33 

0.90 

-0.63 

0.87 

-0.33 

0.55 

1.18 

BMW 

28 

5NBT53 

-0.14 

113 

97 

0.28 

0.84 

-0.88 

0.62 

-1.44 

0.46 

1.18 

BMW 

29 

50A229 

0.62 

99 

71 

0.24 

0.89 

-0.97 

0.79 

-1.24 

0.50 

1.22 

BMW 

30 

5NF79 

0.98 

102 

66 

0.23 

1.01 

0.09 

0.92 

-0.34 

0.41 

1.01 


Note. BMW = Benchmark Winter. 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMW 

31 

I6NS2002 

-1.92 

163 

138 

0.22 

0.91 

-0.63 

0.79 

-1.05 

0.36 

1.11 

BMW 

32 

I6NS4016 

-0.42 

165 

96 

0.17 

0.88 

-2.29 

0.85 

-2.27 

0.47 

1.53 

BMW 

33 

I6NS5006 

0.01 

193 

79 

0.15 

0.93 

-1.42 

0.92 

-1.45 

0.39 

1.32 

BMW 

34 

I6NS5003 

0.15 

164 

76 

0.17 

0.91 

-1.84 

0.90 

-1.73 

0.44 

1.44 

BMW 

35 

I6SP2031 

1.12 

400 

85 

0.13 

1.05 

0.71 

1.07 

0.81 

0.17 

0.93 

BMW 

36 

40297 

-0.89 

60 

47 

0.36 

0.86 

-0.66 

0.67 

-0.61 

0.51 

1.19 

BMW 

37 

40A412 

-0.41 

89 

74 

0.29 

0.95 

-0.25 

0.78 

-0.71 

0.32 

1.09 

BMW 

38 

4G119 

0.41 

113 

82 

0.23 

1.32 

2.81 

1.49 

2.66 

0.01 

0.38 

BMW 

39 

40A124 

1.01 

106 

66 

0.22 

0.96 

-0.50 

0.93 

-0.49 

0.40 

1.13 

BMW 

40 

40A311 

1.53 

90 

36 

0.24 

1.11 

1.23 

1.21 

1.62 

0.27 

0.63 


Note. BMW = Benchmark Winter. 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMS 

1 

50A24 

0.41 

118 

85 

0.22 

0.93 

-0.72 

0.84 

-0.82 

0.37 

1.17 

BMS 

2 

50A311 

1.28 

205 

89 

0.15 

1.05 

0.85 

1.05 

0.76 

0.34 

0.84 

BMS 

3 

50A115 

1.53 

205 

102 

0.15 

0.96 

-0.72 

0.92 

-0.96 

0.46 

1.15 

BMS 

4 

50A329 

2.10 

99 

42 

0.22 

1.00 

-0.01 

0.99 

-0.05 

0.40 

1.02 

BMS 

5 

50464 

-0.72 

51 

37 

0.35 

1.26 

1.42 

1.13 

0.51 

0.26 

0.67 

BMS 

6 

50782 

-0.48 

48 

28 

0.33 

1.03 

0.26 

0.91 

-0.33 

0.45 

1.00 

BMS 

7 

50016 

-0.25 

53 

36 

0.34 

0.92 

-0.45 

0.84 

-0.45 

0.55 

1.14 

BMS 

8 

50476 

-0.03 

52 

31 

0.32 

0.91 

-0.67 

0.84 

-0.70 

0.54 

1.23 

BMS 

9 

50628 

0.20 

53 

31 

0.30 

0.86 

-1.45 

0.82 

-1.18 

0.51 

1.51 

BMS 

10 

50786 

0.42 

273 

197 

0.15 

0.85 

-2.21 

0.71 

-1.92 

0.54 

1.28 

BMS 

11 

5NBT33 

1.18 

113 

57 

0.21 

0.95 

-0.62 

0.99 

-0.11 

0.43 

1.13 

BMS 

12 

50542 

-1.15 

49 

38 

0.37 

0.90 

-0.48 

0.94 

-0.06 

0.41 

1.11 

BMS 

13 

50382 

-0.46 

52 

35 

0.33 

1.05 

0.40 

1.05 

0.26 

0.39 

0.87 

BMS 

14 

50540 

0.46 

282 

199 

0.14 

0.95 

-0.75 

0.93 

-0.55 

0.46 

1.09 

BMS 

15 

5NF69 

1.08 

102 

64 

0.23 

1.04 

0.51 

0.96 

-0.14 

0.39 

0.92 

BMS 

16 

5NF29 

1.56 

124 

61 

0.19 

0.94 

-0.88 

0.91 

-0.83 

0.43 

1.24 

BMS 

17 

50107 

-1.84 

52 

43 

0.40 

0.88 

-0.40 

1.35 

0.85 

0.38 

1.02 

BMS 

18 

50108 

-1.10 

48 

38 

0.39 

0.90 

-0.48 

0.70 

-0.59 

0.42 

1.18 

BMS 

19 

50593 

-0.08 

53 

30 

0.32 

0.99 

-0.06 

1.03 

0.21 

0.49 

0.99 

BMS 

20 

5MD46 

0.22 

121 

88 

0.22 

0.89 

-1.12 

0.79 

-1.19 

0.43 

1.24 

BMS 

21 

5MD21 

0.78 

110 

79 

0.23 

0.94 

-0.57 

0.80 

-1.05 

0.47 

1.15 

BMS 

22 

5MD218 

1.43 

109 

64 

0.21 

0.90 

-1.28 

0.85 

-1.46 

0.49 

1.34 

BMS 

23 

5G26 

0.01 

100 

77 

0.25 

0.96 

-0.28 

0.81 

-0.85 

0.36 

1.10 

BMS 

24 

5G223 

0.39 

108 

74 

0.22 

0.96 

-0.43 

0.83 

-0.89 

0.42 

1.15 

BMS 

25 

5G314 

0.94 

215 

134 

0.15 

0.98 

-0.39 

0.98 

-0.16 

0.40 

1.05 

BMS 

26 

50661 

-1.25 

52 

41 

0.36 

0.93 

-0.31 

0.98 

0.04 

0.36 

1.07 

BMS 

27 

5G122 

-0.33 

111 

91 

0.26 

0.92 

-0.49 

0.81 

-0.70 

0.36 

1.10 

BMS 

28 

5G34 

-0.15 

125 

95 

0.22 

1.03 

0.33 

1.11 

0.63 

0.28 

0.92 

BMS 

29 

51029 

0.62 

56 

28 

0.30 

0.96 

-0.35 

0.90 

-0.62 

0.48 

1.16 

BMS 

30 

50A322 

1.01 

100 

59 

0.22 

0.86 

-1.98 

0.80 

-1.75 

0.51 

1.54 


Note. BMS = Benchmark Spring. 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMS 

31 

I6NS7010 

-1.92 

163 

139 

0.23 

0.89 

-0.69 

0.71 

-1.56 

0.41 

1.13 

BMS 

32 

I6RP2047 

-0.38 

164 

94 

0.17 

0.97 

-0.52 

0.96 

-0.53 

0.33 

1.14 

BMS 

33 

I6NS1019 

-0.03 

2195 

995 

0.05 

0.98 

-1.28 

0.98 

-1.12 

0.33 

1.09 

BMS 

34 

I6RP3028 

0.11 

168 

79 

0.16 

0.91 

-2.00 

0.91 

-1.68 

0.43 

1.50 

BMS 

35 

I6EE9005 

1.15 

161 

44 

0.19 

1.00 

0.07 

1.02 

0.25 

0.31 

0.99 

BMS 

36 

40592 

-0.89 

49 

40 

0.42 

0.87 

-0.46 

0.74 

-0.42 

0.53 

1.13 

BMS 

37 

40A37 

-0.41 

120 

98 

0.25 

0.96 

-0.21 

0.79 

-0.93 

0.38 

1.08 

BMS 

38 

4G232 

0.41 

209 

141 

0.16 

0.91 

-1.49 

0.88 

-1.14 

0.44 

1.23 

BMS 

39 

40A418 

1.04 

105 

65 

0.22 

1.08 

0.98 

1.10 

0.80 

0.30 

0.75 

BMS 

40 

40A54 

1.53 

224 

116 

0.15 

1.03 

0.61 

1.02 

0.25 

0.42 

0.91 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Test Form 


Appendix C: Distractor Statistics by Test Form 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

1 

50A225 

* 

-1 

4650 

98 

0.89 

0.02 

0.00 

-0.04 

1 

1 

50A225 

1 

1 

80 

72 

1.50 

0.11 

0.89 

0.43 

1 

1 

50A225 

2 

0 

17 

15 

0.86 

0.20 

1.24 

-0.15 

1 

1 

50A225 

3 

0 

14 

13 

0.09 

0.17 

0.50 

-0.42 

1 

1 

50A225 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

2 

50A224 

* 

-1 

4661 

98 

0.88 

0.02 

0.00 

-0.10 

1 

2 

50A224 

1 

1 

58 

58 

2.12 

0.15 

1.04 

0.35 

1 

2 

50A224 

2 

0 

26 

26 

1.39 

0.22 

1.90 

-0.20 

1 

2 

50A224 

3 

0 

16 

16 

1.17 

0.21 

0.85 

-0.23 

1 

2 

50A224 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

3 

50A321 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

1 

3 

50A321 

1 

1 

46 

49 

1.87 

0.18 

1.06 

0.40 

1 

3 

50A321 

2 

0 

27 

29 

1.06 

0.13 

0.87 

-0.25 

1 

3 

50A321 

3 

0 

20 

22 

1.02 

0.13 

0.83 

-0.22 

1 

3 

50A321 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

4 

50A316 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.08 

1 

4 

50A316 

1 

1 

36 

39 

2.23 

0.15 

0.92 

0.46 

1 

4 

50A316 

2 

0 

28 

30 

1.42 

0.13 

0.88 

-0.21 

1 

4 

50A316 

3 

0 

29 

31 

1.35 

0.14 

0.85 

-0.27 

1 

4 

50A316 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

5 

50799 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

1 

5 

50799 

1 

1 

32 

65 

0.67 

0.22 

0.90 

0.49 

1 

5 

50799 

2 

0 

3 

6 

-1.58 

0.50 

0.27 

-0.34 

1 

5 

50799 

3 

0 

10 

20 

-0.24 

0.31 

1.09 

-0.17 

1 

5 

50799 

4 

0 

4 

8 

-1.13 

0.08 

0.34 

-0.30 

1 

6 

50641 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

1 

6 

50641 

1 

1 

34 

65 

0.81 

0.25 

1.12 

0.37 

1 

6 

50641 

2 

0 

1 

2 

-0.34 

0.00 

0.61 

-0.08 

1 

6 

50641 

3 

0 

8 

15 

-0.61 

0.25 

0.60 

-0.34 

1 

6 

50641 

4 

0 

9 

17 

0.12 

0.26 

1.29 

-0.11 



easyCBM CCSS Fifth Grade Math Measure Development 


90 

Appendix C: Distractor by Test Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

7 

50045 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

1 

7 

50045 

1 

1 

36 

65 

1.12 

0.25 

1.09 

0.42 

1 

7 

50045 

2 

0 

9 

16 

0.24 

0.35 

1.51 

-0.13 

1 

7 

50045 

3 

0 

4 

7 

0.11 

0.49 

1.14 

-0.10 

1 

7 

50045 

4 

0 

6 

11 

-1.05 

0.21 

0.29 

-0.41 

1 

8 

50644 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.01 

1 

8 

50644 

1 

1 

36 

64 

0.99 

0.22 

1.18 

0.24 

1 

8 

50644 

2 

0 

9 

16 

0.26 

0.57 

1.89 

-0.17 

1 

8 

50644 

3 

0 

6 

11 

0.70 

0.20 

1.31 

-0.02 

1 

8 

50644 

4 

0 

5 

9 

0.13 

0.37 

0.90 

-0.15 

1 

9 

50028 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

1 

9 

50028 

1 

1 

26 

53 

0.65 

0.21 

1.10 

0.31 

1 

9 

50028 

2 

0 

1 

2 

-0.71 

0.00 

0.36 

-0.16 

1 

9 

50028 

3 

0 

11 

22 

0.46 

0.11 

1.22 

0.05 

1 

9 

50028 

4 

0 

11 

22 

-0.30 

0.29 

0.86 

-0.36 

1 

10 

51080 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

1 

10 

51080 

1 

1 

25 

47 

1.05 

0.26 

0.86 

0.49 

1 

10 

51080 

2 

0 

5 

9 

0.06 

0.56 

1.14 

-0.05 

1 

10 

51080 

3 

0 

10 

19 

-0.13 

0.17 

0.74 

-0.15 

1 

10 

51080 

4 

0 

13 

25 

-0.69 

0.44 

0.91 

-0.40 

1 

11 

5NBT511 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

1 

11 

5NBT511 

1 

1 

70 

72 

2.71 

0.14 

1.08 

0.39 

1 

11 

5NBT511 

2 

0 

17 

18 

1.80 

0.17 

0.83 

-0.26 

1 

11 

5NBT511 

3 

0 

10 

10 

1.59 

0.31 

0.89 

-0.25 

1 

11 

5NBT511 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

12 

50096 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

1 

12 

50096 

1 

1 

40 

80 

0.72 

0.20 

1.19 

0.22 

1 

12 

50096 

2 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

12 

50096 

3 

0 

10 

20 

0.05 

0.27 

1.33 

-0.22 

1 

12 

50096 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

13 

50385 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

1 

13 

50385 

1 

1 

32 

65 

1.03 

0.25 

1.07 

0.50 

1 

13 

50385 

2 

0 

3 

6 

0.01 

0.39 

0.94 

-0.05 

1 

13 

50385 

3 

0 

4 

8 

-0.15 

0.60 

1.13 

-0.08 

1 

13 

50385 

4 

0 

10 

20 

-1.47 

0.74 

0.82 

-0.50 

1 

14 

50992 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

1 

14 

50992 

1 

1 

23 

48 

0.98 

0.23 

0.93 

0.49 

1 

14 

50992 

2 

0 

6 

13 

0.06 

0.33 

0.95 

-0.09 

1 

14 

50992 

3 

0 

10 

21 

0.04 

0.22 

0.85 

-0.13 

1 

14 

50992 

4 

0 

9 

19 

-0.70 

0.50 

0.62 

-0.41 

1 

15 

5NF35 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

1 

15 

5NF35 

1 

1 

72 

74 

2.78 

0.13 

0.93 

0.50 

1 

15 

5NF35 

2 

0 

18 

19 

1.58 

0.18 

0.75 

-0.35 

1 

15 

5NF35 

3 

0 

7 

7 

1.11 

0.18 

0.39 

-0.32 

1 

15 

5NF35 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

16 

50989 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

1 

16 

50989 

1 

1 

16 

33 

1.29 

0.34 

1.29 

0.34 

1 

16 

50989 

2 

0 

21 

43 

0.66 

0.22 

1.29 

-0.04 

1 

16 

50989 

3 

0 

2 

4 

0.91 

0.10 

1.04 

0.03 

1 

16 

50989 

4 

0 

10 

20 

-0.14 

0.29 

0.54 

-0.37 

1 

17 

50270 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

1 

17 

50270 

1 

1 

48 

87 

0.78 

0.17 

1.05 

0.36 

1 

17 

50270 

2 

0 

2 

4 

-0.05 

0.21 

0.89 

-0.10 

1 

17 

50270 

3 

0 

4 

7 

-0.48 

0.41 

0.72 

-0.25 

1 

17 

50270 

4 

0 

1 

2 

-1.75 

0.00 

0.16 

-0.26 

1 

18 

50554 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

1 

18 

50554 

1 

1 

40 

78 

0.68 

0.22 

1.29 

0.23 

1 

18 

50554 

2 

0 

8 

16 

-0.18 

0.25 

0.93 

-0.23 

1 

18 

50554 

3 

0 

1 

2 

1.40 

0.00 

3.68 

0.09 

1 

18 

50554 

4 

0 

2 

4 

-0.26 

1.11 

1.18 

-0.12 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

19 

50896 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

1 

19 

50896 

1 

1 

30 

61 

1.15 

0.25 

0.91 

0.53 

1 

19 

50896 

2 

0 

4 

8 

-0.39 

0.17 

0.53 

-0.18 

1 

19 

50896 

3 

0 

7 

14 

-0.49 

0.36 

0.65 

-0.27 

1 

19 

50896 

4 

0 

8 

16 

-0.54 

0.59 

0.72 

-0.31 

1 

20 

51026 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.02 

1 

20 

51026 

1 

1 

33 

58 

1.12 

0.22 

1.08 

0.44 

1 

20 

51026 

2 

0 

11 

19 

0.06 

0.32 

1.08 

-0.21 

1 

20 

51026 

3 

0 

4 

7 

0.00 

0.37 

0.75 

-0.13 

1 

20 

51026 

4 

0 

9 

16 

-0.23 

0.51 

0.79 

-0.28 

1 

21 

5MD57 

* 

-1 

4647 

98 

0.89 

0.02 

0.00 

-0.04 

1 

21 

5MD57 

1 

1 

65 

57 

1.58 

0.13 

0.99 

0.40 

1 

21 

5MD57 

2 

0 

27 

24 

0.73 

0.13 

0.83 

-0.26 

1 

21 

5MD57 

3 

0 

22 

19 

0.76 

0.20 

1.09 

-0.22 

1 

21 

5MD57 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

22 

50293 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

1 

22 

50293 

1 

1 

14 

27 

1.48 

0.29 

0.56 

0.56 

1 

22 

50293 

2 

0 

7 

13 

0.32 

0.72 

5.80 

0.01 

1 

22 

50293 

3 

0 

7 

13 

-0.41 

0.28 

0.52 

-0.21 

1 

22 

50293 

4 

0 

24 

46 

-0.22 

0.18 

0.71 

-0.36 

1 

23 

5G115 

* 

-1 

4653 

98 

0.89 

0.02 

0.00 

-0.05 

1 

23 

5G115 

1 

1 

82 

76 

1.59 

0.12 

0.94 

0.37 

1 

23 

5G115 

2 

0 

1 

1 

0.21 

0.00 

0.40 

-0.11 

1 

23 

5G115 

3 

0 

25 

23 

0.70 

0.16 

0.94 

-0.35 

1 

23 

5G115 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

24 

5G49 

* 

-1 

4556 

96 

0.87 

0.02 

0.00 

-0.10 

1 

24 

5G49 

1 

1 

150 

73 

1.76 

0.08 

1.00 

0.36 

1 

24 

5G49 

2 

0 

38 

19 

1.04 

0.13 

1.11 

-0.24 

1 

24 

5G49 

3 

0 

17 

8 

0.78 

0.16 

0.71 

-0.23 

1 

24 

5G49 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

25 

5G323 

* 

-1 

4646 

98 

0.88 

0.02 

0.00 

-0.12 

1 

25 

5G323 

1 

1 

83 

72 

2.20 

0.11 

1.03 

0.42 

1 

25 

5G323 

2 

0 

7 

6 

1.16 

0.38 

0.87 

-0.18 

1 

25 

5G323 

3 

0 

25 

22 

1.23 

0.16 

0.86 

-0.35 

1 

25 

5G323 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

26 

51060 

* 

-1 

4714 

99 

0.90 

0.02 

0.00 

0.00 

1 

26 

51060 

1 

1 

40 

85 

1.11 

0.16 

0.82 

0.51 

1 

26 

51060 

2 

0 

1 

2 

-0.87 

0.00 

0.26 

-0.22 

1 

26 

51060 

3 

0 

5 

11 

-0.13 

0.24 

0.62 

-0.30 

1 

26 

51060 

4 

0 

1 

2 

-2.36 

0.00 

0.06 

-0.41 

1 

27 

50549 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

1 

27 

50549 

1 

1 

37 

67 

1.10 

0.22 

1.32 

0.43 

1 

27 

50549 

2 

0 

7 

13 

-0.03 

0.39 

0.88 

-0.20 

1 

27 

50549 

3 

0 

9 

16 

-0.30 

0.20 

0.57 

-0.31 

1 

27 

50549 

4 

0 

2 

4 

-0.06 

2.22 

2.89 

-0.10 

1 

28 

50509 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.04 

1 

28 

50509 

1 

1 

34 

62 

0.91 

0.16 

0.83 

0.53 

1 

28 

50509 

2 

0 

7 

13 

-0.65 

0.39 

0.58 

-0.36 

1 

28 

50509 

3 

0 

6 

11 

-0.12 

0.35 

0.93 

-0.17 

1 

28 

50509 

4 

0 

8 

15 

-0.20 

0.42 

0.87 

-0.23 

1 

29 

50143 

* 

-1 

4697 

99 

0.91 

0.02 

0.00 

0.02 

1 

29 

50143 

1 

1 

32 

50 

1.21 

0.20 

0.97 

0.45 

1 

29 

50143 

2 

0 

17 

27 

-0.06 

0.31 

0.89 

-0.32 

1 

29 

50143 

3 

0 

5 

8 

-0.10 

0.74 

1.79 

-0.16 

1 

29 

50143 

4 

0 

10 

16 

0.34 

0.31 

1.05 

-0.10 

1 

30 

5MD56 

* 

-1 

4551 

96 

0.86 

0.02 

0.00 

-0.13 

1 

30 

5MD56 

1 

1 

137 

65 

2.17 

0.08 

0.81 

0.58 

1 

30 

5MD56 

2 

0 

44 

21 

0.91 

0.10 

0.65 

-0.39 

1 

30 

5MD56 

3 

0 

29 

14 

0.78 

0.10 

0.55 

-0.35 

1 

30 

5MD56 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

1 

50A215 

* 

-1 

4668 

98 

0.89 

0.02 

0 

-0.08 

2 

1 

50A215 

1 

1 

74 

80 

1.86 

0.1 

0.99 

0.34 

2 

1 

50A215 

2 

0 

10 

11 

0.93 

0.14 

0.63 

-0.3 

2 

1 

50A215 

3 

0 

9 

10 

1.32 

0.29 

1.23 

-0.14 

2 

1 

50A215 

4 

0 

0 

0 

0 

0 

0 

0 

2 

2 

50A112 

* 

-1 

4649 

98 

0.88 

0.02 

0 

-0.11 

2 

2 

50A112 

1 

1 

71 

63 

2.22 

0.09 

0.84 

0.51 

2 

2 

50A112 

2 

0 

11 

10 

1.15 

0.2 

0.67 

-0.29 

2 

2 

50A112 

3 

0 

30 

27 

1.39 

0.12 

0.82 

-0.36 

2 

2 

50A112 

4 

0 

0 

0 

0 

0 

0 

0 

2 

3 

50A314 

* 

-1 

4662 

98 

0.88 

0.02 

0 

-0.09 

2 

3 

50A314 

1 

1 

53 

54 

2.11 

0.12 

1 

0.43 

2 

3 

50A314 

2 

0 

19 

19 

1.38 

0.17 

0.93 

-0.18 

2 

3 

50A314 

3 

0 

27 

27 

1.23 

0.19 

1 

-0.32 

2 

3 

50A314 

4 

0 

0 

0 

0 

0 

0 

0 

2 

4 

50A315 

* 

-1 

4666 

98 

0.88 

0.02 

0 

-0.1 

2 

4 

50A315 

1 

1 

41 

43 

2.25 

0.14 

1.07 

0.38 

2 

4 

50A315 

2 

0 

25 

26 

1.35 

0.14 

0.76 

-0.33 

2 

4 

50A315 

3 

0 

29 

31 

1.74 

0.16 

1.17 

-0.09 

2 

4 

50A315 

4 

0 

0 

0 

0 

0 

0 

0 

2 

5 

50308 

* 

-1 

4704 

99 

0.91 

0.02 

0 

0.02 

2 

5 

50308 

1 

1 

43 

75 

0.96 

0.15 

0.95 

0.48 

2 

5 

50308 

2 

0 

1 

2 

-0.93 

0 

0.27 

-0.18 

2 

5 

50308 

3 

0 

7 

12 

-0.4 

0.56 

1.41 

-0.34 

2 

5 

50308 

4 

0 

6 

11 

-0.14 

0.38 

0.9 

-0.23 

2 

6 

51056 

* 

-1 

4715 

99 

0.91 

0.02 

0 

0.06 

2 

6 

51056 

1 

1 

29 

63 

0.88 

0.26 

1.16 

0.51 

2 

6 

51056 

2 

0 

5 

11 

0.45 

0.54 

2.34 

0.06 

2 

6 

51056 

3 

0 

5 

11 

-0.84 

0.22 

0.43 

-0.18 

2 

6 

51056 

4 

0 

7 

15 

-2.44 

0.95 

0.41 

-0.57 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

7 

50761 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.04 

2 

7 

50761 

1 

1 

29 

60 

1.14 

0.26 

0.67 

0.63 

2 

7 

50761 

2 

0 

3 

6 

-0.08 

0.32 

1.01 

-0.08 

2 

7 

50761 

3 

0 

10 

21 

-1 

0.24 

0.49 

-0.46 

2 

7 

50761 

4 

0 

6 

13 

-0.9 

0.42 

0.55 

-0.31 

2 

8 

50928 

* 

-1 

4712 

99 

0.9 

0.02 

0 

0.02 

2 

8 

50928 

1 

1 

31 

63 

1.26 

0.19 

0.77 

0.58 

2 

8 

50928 

2 

0 

6 

12 

0.41 

0.52 

2 

-0.09 

2 

8 

50928 

3 

0 

6 

12 

-0.77 

0.37 

0.41 

-0.44 

2 

8 

50928 

4 

0 

6 

12 

-0.38 

0.19 

0.46 

-0.33 

2 

9 

50336 

* 

-1 

4709 

99 

0.9 

0.02 

0 

0.01 

2 

9 

50336 

1 

1 

31 

60 

1.15 

0.18 

0.9 

0.51 

2 

9 

50336 

2 

0 

7 

13 

0.03 

0.23 

0.66 

-0.26 

2 

9 

50336 

3 

0 

6 

12 

0.48 

0.48 

1.62 

-0.08 

2 

9 

50336 

4 

0 

8 

15 

-0.19 

0.16 

0.49 

-0.37 

2 

10 

5NBT613 

* 

-1 

4657 

98 

0.88 

0.02 

0 

-0.1 

2 

10 

5NBT613 

1 

1 

77 

74 

2.02 

0.13 

0.99 

0.38 

2 

10 

5NBT613 

2 

0 

10 

10 

0.98 

0.24 

0.84 

-0.22 

2 

10 

5NBT613 

3 

0 

17 

16 

1.08 

0.19 

0.87 

-0.27 

2 

10 

5NBT613 

4 

0 

0 

0 

0 

0 

0 

0 

2 

11 

50324 

* 

-1 

4708 

99 

0.9 

0.02 

0 

0 

2 

11 

50324 

1 

1 

23 

43 

1.86 

0.27 

0.8 

0.61 

2 

11 

50324 

2 

0 

8 

15 

0.07 

0.46 

0.96 

-0.26 

2 

11 

50324 

3 

0 

12 

23 

0.31 

0.23 

0.74 

-0.24 

2 

11 

50324 

4 

0 

10 

19 

0.13 

0.3 

0.65 

-0.28 

2 

12 

50836 

* 

-1 

4712 

99 

0.9 

0.02 

0 

0.02 

2 

12 

50836 

1 

1 

39 

80 

0.93 

0.22 

1.13 

0.39 

2 

12 

50836 

2 

0 

3 

6 

0.53 

0.83 

3.02 

-0.02 

2 

12 

50836 

3 

0 

4 

8 

-0.9 

0.4 

0.43 

-0.32 

2 

12 

50836 

4 

0 

3 

6 

-0.86 

0.75 

0.6 

-0.27 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

13 

50691 

* 

-1 

4708 

99 

0.91 

0.02 

0 

0.03 

2 

13 

50691 

1 

1 

36 

68 

0.89 

0.19 

0.88 

0.43 

2 

13 

50691 

2 

0 

1 

2 

0.9 

0 

1.94 

0.04 

2 

13 

50691 

3 

0 

13 

25 

-0.02 

0.32 

1.62 

-0.21 

2 

13 

50691 

4 

0 

3 

6 

-2.32 

0.77 

0.12 

-0.5 

2 

14 

50539 

* 

-1 

4472 

94 

0.86 

0.02 

0 

-0.12 

2 

14 

50539 

1 

1 

203 

70 

1.95 

0.07 

0.9 

0.49 

2 

14 

50539 

2 

0 

35 

12 

0.79 

0.14 

0.8 

-0.23 

2 

14 

50539 

3 

0 

30 

10 

0.85 

0.19 

1.02 

-0.2 

2 

14 

50539 

4 

0 

21 

7 

0.03 

0.32 

0.54 

-0.35 

2 

15 

50507 

* 

-1 

4708 

99 

0.91 

0.02 

0 

0.04 

2 

15 

50507 

1 

1 

20 

38 

0.81 

0.3 

1.56 

0.26 

2 

15 

50507 

2 

0 

11 

21 

0.26 

0.25 

1 

-0.08 

2 

15 

50507 

3 

0 

20 

38 

0.25 

0.23 

1.12 

-0.12 

2 

15 

50507 

4 

0 

2 

4 

-0.59 

0.4 

0.35 

-0.18 

2 

16 

5NF43 

* 

-1 

4665 

98 

0.88 

0.02 

0 

-0.1 

2 

16 

5NF43 

1 

1 

53 

55 

2.08 

0.13 

1.14 

0.28 

2 

16 

5NF43 

2 

0 

31 

32 

1.61 

0.14 

1.09 

-0.19 

2 

16 

5NF43 

3 

0 

12 

13 

1.49 

0.2 

0.9 

-0.15 

2 

16 

5NF43 

4 

0 

0 

0 

0 

0 

0 

0 

2 

17 

50552 

* 

-1 

4708 

99 

0.91 

0.02 

0 

0.03 

2 

17 

50552 

1 

1 

46 

87 

0.73 

0.18 

1 

0.45 

2 

17 

50552 

2 

0 

2 

4 

-0.34 

0.14 

0.76 

-0.13 

2 

17 

50552 

3 

0 

4 

8 

-1.28 

0.72 

0.52 

-0.39 

2 

17 

50552 

4 

0 

1 

2 

-1.44 

0 

0.25 

-0.2 

2 

18 

50869 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.02 

2 

18 

50869 

1 

1 

39 

80 

0.84 

0.18 

0.98 

0.39 

2 

18 

50869 

2 

0 

1 

2 

0.47 

0 

1.22 

-0.02 

2 

18 

50869 

3 

0 

8 

16 

-0.4 

0.28 

0.63 

-0.39 

2 

18 

50869 

4 

0 

1 

2 

0.03 

0 

0.79 

-0.07 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

19 

50729 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.03 

2 

19 

50729 

1 

1 

30 

63 

0.85 

0.2 

1.06 

0.39 

2 

19 

50729 

2 

0 

8 

17 

0.06 

0.35 

0.99 

-0.18 

2 

19 

50729 

3 

0 

6 

13 

-0.51 

0.26 

0.49 

-0.35 

2 

19 

50729 

4 

0 

4 

8 

0.45 

0.41 

1.48 

-0.02 

2 

20 

50111 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.04 

2 

20 

50111 

1 

1 

28 

54 

1.02 

0.28 

1.4 

0.41 

2 

20 

50111 

2 

0 

10 

19 

0.29 

0.29 

1.29 

-0.03 

2 

20 

50111 

3 

0 

7 

13 

-0.19 

0.37 

0.8 

-0.14 

2 

20 

50111 

4 

0 

7 

13 

-1.29 

0.88 

0.5 

-0.41 

2 

21 

50403 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.05 

2 

21 

50403 

1 

1 

19 

38 

0.85 

0.29 

1.05 

0.4 

2 

21 

50403 

2 

0 

10 

20 

-0.05 

0.26 

0.92 

-0.15 

2 

21 

50403 

3 

0 

16 

32 

-0.22 

0.25 

1.18 

-0.31 

2 

21 

50403 

4 

0 

5 

10 

0.4 

0.23 

1.24 

0.03 

2 

22 

5MD122 

* 

-1 

4649 

98 

0.88 

0.02 

0 

-0.12 

2 

22 

5MD122 

1 

1 

66 

59 

2.21 

0.13 

1.12 

0.3 

2 

22 

5MD122 

2 

0 

25 

22 

1.84 

0.2 

1.42 

-0.05 

2 

22 

5MD122 

3 

0 

21 

19 

1.22 

0.19 

0.81 

-0.33 

2 

22 

5MD122 

4 

0 

0 

0 

0 

0 

0 

0 

2 

23 

5G210 

* 

-1 

4633 

97 

0.88 

0.02 

0 

-0.08 

2 

23 

5G210 

1 

1 

100 

78 

1.78 

0.1 

0.9 

0.39 

2 

23 

5G210 

2 

0 

15 

12 

0.68 

0.2 

0.73 

-0.31 

2 

23 

5G210 

3 

0 

13 

10 

0.92 

0.14 

0.78 

-0.21 

2 

23 

5G210 

4 

0 

0 

0 

0 

0 

0 

0 

2 

24 

5G41 

* 

-1 

4663 

98 

0.89 

0.02 

0 

-0.09 

2 

24 

5G41 

1 

1 

75 

77 

1.85 

0.1 

1 

0.27 

2 

24 

5G41 

2 

0 

13 

13 

1.35 

0.25 

1.18 

-0.16 

2 

24 

5G41 

3 

0 

10 

10 

1.19 

0.24 

0.92 

-0.2 

2 

24 

5G41 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

25 

5G418 

* 

-1 

4656 

98 

0.88 

0.02 

0 

-0.1 

2 

25 

5G418 

1 

1 

70 

67 

2.1 

0.14 

0.98 

0.4 

2 

25 

5G418 

2 

0 

12 

11 

1.08 

0.32 

1.17 

-0.22 

2 

25 

5G418 

3 

0 

23 

22 

1.14 

0.14 

0.81 

-0.29 

2 

25 

5G418 

4 

0 

0 

0 

0 

0 

0 

0 

2 

26 

50647 

* 

-1 

4707 

99 

0.9 

0.02 

0 

0.02 

2 

26 

50647 

1 

1 

45 

83 

0.89 

0.14 

0.89 

0.43 

2 

26 

50647 

2 

0 

4 

7 

0.3 

0.64 

1.7 

-0.1 

2 

26 

50647 

3 

0 

3 

6 

-0.95 

0.32 

0.31 

-0.37 

2 

26 

50647 

4 

0 

2 

4 

-0.65 

0.51 

0.42 

-0.25 

2 

27 

50523 

* 

-1 

4706 

99 

0.9 

0.02 

0 

0.02 

2 

27 

50523 

1 

1 

37 

67 

1.03 

0.21 

1 

0.37 

2 

27 

50523 

2 

0 

14 

25 

0.29 

0.27 

1.42 

-0.18 

2 

27 

50523 

3 

0 

2 

4 

-0.54 

0.39 

0.42 

-0.18 

2 

27 

50523 

4 

0 

2 

4 

-1.49 

0.97 

0.23 

-0.32 

2 

28 

50816 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.03 

2 

28 

50816 

1 

1 

30 

63 

0.91 

0.2 

0.9 

0.44 

2 

28 

50816 

2 

0 

1 

2 

-0.43 

0 

0.46 

-0.12 

2 

28 

50816 

3 

0 

12 

25 

0.13 

0.29 

1.23 

-0.2 

2 

28 

50816 

4 

0 

5 

10 

-0.7 

0.38 

0.47 

-0.36 

2 

29 

50337 

* 

-1 

4708 

99 

0.9 

0.02 

0 

0 

2 

29 

50337 

1 

1 

28 

53 

1.69 

0.26 

0.67 

0.6 

2 

29 

50337 

2 

0 

6 

11 

0.2 

0.47 

1.14 

-0.18 

2 

29 

50337 

3 

0 

9 

17 

-0.05 

0.24 

0.65 

-0.31 

2 

29 

50337 

4 

0 

10 

19 

-0.06 

0.22 

0.59 

-0.33 

2 

30 

5MD412 

* 

-1 

4656 

98 

0.89 

0.02 

0 

-0.06 

2 

30 

5MD412 

1 

1 

64 

61 

1.84 

0.1 

0.8 

0.57 

2 

30 

5MD412 

2 

0 

11 

10 

0.89 

0.12 

0.68 

-0.22 

2 

30 

5MD412 

3 

0 

30 

29 

0.8 

0.11 

0.71 

-0.46 

2 

30 

5MD412 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

1 

50A222 

* 

-1 

4668 

98 

0.89 

0.02 

0 

-0.06 

3 

1 

50A222 

1 

1 

69 

74 

1.72 

0.13 

0.93 

0.43 

3 

1 

50A222 

2 

0 

15 

16 

0.81 

0.1 

0.72 

-0.28 

3 

1 

50A222 

3 

0 

9 

10 

0.51 

0.2 

0.57 

-0.3 

3 

1 

50A222 

4 

0 

0 

0 

0 

0 

0 

0 

3 

2 

50A29 

* 

-1 

4661 

98 

0.88 

0.02 

0 

-0.1 

3 

2 

50A29 

1 

1 

59 

59 

2.11 

0.15 

1 

0.34 

3 

2 

50A29 

2 

0 

32 

32 

1.37 

0.19 

1.48 

-0.24 

3 

2 

50A29 

3 

0 

9 

9 

1.09 

0.28 

0.77 

-0.19 

3 

2 

50A29 

4 

0 

0 

0 

0 

0 

0 

0 

3 

3 

50A227 

* 

-1 

4664 

98 

0.88 

0.02 

0 

-0.12 

3 

3 

50A227 

1 

1 

58 

60 

2.26 

0.15 

1.05 

0.31 

3 

3 

50A227 

2 

0 

24 

25 

1.79 

0.23 

1.88 

-0.09 

3 

3 

50A227 

3 

0 

15 

15 

1.13 

0.13 

0.56 

-0.32 

3 

3 

50A227 

4 

0 

0 

0 

0 

0 

0 

0 

3 

4 

50 A3 9 

* 

-1 

4661 

98 

0.88 

0.02 

0 

-0.1 

3 

4 

50 A3 9 

1 

1 

42 

42 

2.31 

0.21 

1.18 

0.39 

3 

4 

50 A3 9 

2 

0 

23 

23 

1.04 

0.17 

0.64 

-0.35 

3 

4 

50 A3 9 

3 

0 

35 

35 

1.64 

0.14 

1.13 

-0.09 

3 

4 

50 A3 9 

4 

0 

0 

0 

0 

0 

0 

0 

3 

5 

51095 

* 

-1 

4705 

99 

0.91 

0.02 

0 

0.03 

3 

5 

51095 

1 

1 

41 

73 

0.94 

0.18 

0.93 

0.42 

3 

5 

51095 

2 

0 

6 

11 

0.26 

0.61 

1.97 

-0.08 

3 

5 

51095 

3 

0 

3 

5 

-0.23 

1.09 

1.43 

-0.14 

3 

5 

51095 

4 

0 

6 

11 

-1.12 

0.63 

0.48 

-0.42 

3 

6 

50047 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

3 

6 

50047 

1 

1 

33 

67 

0.98 

0.22 

0.88 

0.52 

3 

6 

50047 

2 

0 

4 

8 

0 

0.69 

1.44 

-0.11 

3 

6 

50047 

3 

0 

5 

10 

-0.82 

0.36 

0.46 

-0.33 

3 

6 

50047 

4 

0 

7 

14 

-0.6 

0.21 

0.52 

-0.33 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

7 

50624 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.03 

3 

7 

50624 

1 

1 

33 

65 

0.93 

0.2 

1.16 

0.5 

3 

7 

50624 

2 

0 

8 

16 

-0.8 

0.2 

0.38 

-0.47 

3 

7 

50624 

3 

0 

2 

4 

-0.88 

0.03 

0.3 

-0.23 

3 

7 

50624 

4 

0 

8 

16 

0.32 

0.35 

1.56 

-0.06 

3 

8 

50189 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.03 

3 

8 

50189 

1 

1 

31 

61 

0.91 

0.15 

0.84 

0.53 

3 

8 

50189 

2 

0 

1 

2 

-0.17 

0 

0.56 

-0.09 

3 

8 

50189 

3 

0 

7 

14 

-0.68 

0.32 

0.44 

-0.47 

3 

8 

50189 

4 

0 

12 

24 

0.15 

0.24 

0.96 

-0.19 

3 

9 

50639 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.04 

3 

9 

50639 

1 

1 

26 

53 

1.04 

0.18 

0.77 

0.58 

3 

9 

50639 

2 

0 

7 

14 

-0.65 

0.5 

0.61 

-0.31 

3 

9 

50639 

3 

0 

3 

6 

-0.06 

0.83 

1.07 

-0.08 

3 

9 

50639 

4 

0 

13 

27 

-0.47 

0.34 

1.28 

-0.37 

3 

10 

50759 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.05 

3 

10 

50759 

1 

1 

22 

46 

0.69 

0.19 

0.84 

0.45 

3 

10 

50759 

2 

0 

6 

13 

-0.06 

0.31 

0.96 

-0.09 

3 

10 

50759 

3 

0 

5 

10 

-0.2 

0.43 

0.89 

-0.13 

3 

10 

50759 

4 

0 

15 

31 

-0.3 

0.28 

1.06 

-0.33 

3 

11 

50021 

* 

-1 

4698 

99 

0.9 

0.02 

0 

0.01 

3 

11 

50021 

1 

1 

26 

41 

1.88 

0.27 

0.85 

0.64 

3 

11 

50021 

2 

0 

7 

11 

0.13 

0.3 

0.63 

-0.17 

3 

11 

50021 

3 

0 

9 

14 

0.15 

0.21 

0.62 

-0.2 

3 

11 

50021 

4 

0 

21 

33 

0.02 

0.21 

0.65 

-0.41 

3 

12 

50974 

* 

-1 

4712 

99 

0.9 

0.02 

0 

0.01 

3 

12 

50974 

1 

1 

40 

82 

1.09 

0.18 

0.83 

0.46 

3 

12 

50974 

2 

0 

3 

6 

-0.82 

0.45 

0.37 

-0.31 

3 

12 

50974 

3 

0 

4 

8 

0.73 

0.34 

1.66 

-0.02 

3 

12 

50974 

4 

0 

2 

4 

-2.53 

1.47 

0.12 

-0.51 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

13 

50082 

* 

-1 

4710 

99 

0.9 

0.02 

0 

0 

3 

13 

50082 

1 

1 

38 

75 

1.21 

0.21 

1.04 

0.33 

3 

13 

50082 

2 

0 

9 

18 

0.4 

0.54 

2.1 

-0.19 

3 

13 

50082 

3 

0 

2 

4 

-0.19 

0.39 

0.5 

-0.17 

3 

13 

50082 

4 

0 

2 

4 

-0.45 

0 

0.36 

-0.21 

3 

14 

50543 

* 

-1 

4701 

99 

0.91 

0.02 

0 

0.02 

3 

14 

50543 

1 

1 

31 

52 

1.35 

0.22 

0.88 

0.6 

3 

14 

50543 

2 

0 

10 

17 

0.3 

0.2 

0.94 

-0.11 

3 

14 

50543 

3 

0 

14 

23 

-0.11 

0.15 

0.6 

-0.31 

3 

14 

50543 

4 

0 

5 

8 

-1.29 

0.38 

0.2 

-0.45 

3 

15 

5NF311 

* 

-1 

4667 

98 

0.89 

0.02 

0 

-0.06 

3 

15 

5NF311 

1 

1 

54 

57 

1.76 

0.15 

1.05 

0.35 

3 

15 

5NF311 

2 

0 

20 

21 

1.19 

0.17 

1.17 

-0.13 

3 

15 

5NF311 

3 

0 

20 

21 

0.87 

0.13 

0.75 

-0.29 

3 

15 

5NF311 

4 

0 

0 

0 

0 

0 

0 

0 

3 

16 

5NF46 

* 

-1 

4664 

98 

0.87 

0.02 

0 

-0.16 

3 

16 

5NF46 

1 

1 

63 

65 

2.91 

0.13 

0.84 

0.56 

3 

16 

5NF46 

2 

0 

23 

24 

1.65 

0.17 

0.73 

-0.38 

3 

16 

5NF46 

3 

0 

11 

11 

1.36 

0.19 

0.49 

-0.33 

3 

16 

5NF46 

4 

0 

0 

0 

0 

0 

0 

0 

3 

17 

50272 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.05 

3 

17 

50272 

1 

1 

42 

86 

0.41 

0.18 

1.03 

0.3 

3 

17 

50272 

2 

0 

1 

2 

0.07 

0 

1.21 

-0.03 

3 

17 

50272 

3 

0 

5 

10 

-0.87 

0.41 

0.6 

-0.33 

3 

17 

50272 

4 

0 

1 

2 

0.33 

0 

1.58 

0.01 

3 

18 

50556 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.06 

3 

18 

50556 

1 

1 

37 

73 

0.21 

0.19 

1.18 

0.19 

3 

18 

50556 

2 

0 

5 

10 

-0.7 

0.54 

0.92 

-0.23 

3 

18 

50556 

3 

0 

8 

16 

-0.15 

0.39 

1.79 

-0.09 

3 

18 

50556 

4 

0 

1 

2 

0.86 

0 

2.76 

0.1 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

19 

51170 

* 

-1 

4706 

99 

0.9 

0.02 

0 

0.02 

3 

19 

51170 

1 

1 

35 

64 

1.35 

0.23 

0.87 

0.6 

3 

19 

51170 

2 

0 

4 

7 

-0.6 

0.55 

0.52 

-0.24 

3 

19 

51170 

3 

0 

6 

11 

-0.19 

0.45 

0.81 

-0.21 

3 

19 

51170 

4 

0 

10 

18 

-0.6 

0.23 

0.45 

-0.41 

3 

20 

51156 

* 

-1 

4710 

99 

0.9 

0.02 

0 

0.02 

3 

20 

51156 

1 

1 

30 

59 

1.15 

0.22 

1 

0.47 

3 

20 

51156 

2 

0 

5 

10 

0.27 

0.7 

1.86 

-0.1 

3 

20 

51156 

3 

0 

15 

29 

-0.2 

0.22 

0.66 

-0.43 

3 

20 

51156 

4 

0 

1 

2 

0.52 

0 

1.01 

-0.01 

3 

21 

5MD48 

* 

-1 

4667 

98 

0.89 

0.02 

0 

-0.06 

3 

21 

5MD48 

1 

1 

60 

64 

1.76 

0.14 

0.98 

0.4 

3 

21 

5MD48 

2 

0 

24 

26 

1.03 

0.15 

1.03 

-0.24 

3 

21 

5MD48 

3 

0 

10 

11 

0.61 

0.12 

0.55 

-0.28 

3 

21 

5MD48 

4 

0 

0 

0 

0 

0 

0 

0 

3 

22 

51174 

* 

-1 

4705 

99 

0.9 

0.02 

0 

0.01 

3 

22 

51174 

1 

1 

21 

38 

1.94 

0.31 

0.71 

0.6 

3 

22 

51174 

2 

0 

26 

46 

0.09 

0.22 

0.91 

-0.38 

3 

22 

51174 

3 

0 

3 

5 

0.34 

1.02 

1.77 

-0.06 

3 

22 

51174 

4 

0 

6 

11 

-0.54 

0.48 

0.4 

-0.28 

3 

23 

5G27 

* 

-1 

4537 

95 

0.86 

0.02 

0 

-0.15 

3 

23 

5G27 

1 

1 

182 

81 

1.93 

0.06 

0.97 

0.31 

3 

23 

5G27 

2 

0 

7 

3 

0.43 

0.32 

0.43 

-0.27 

3 

23 

5G27 

3 

0 

35 

16 

1.37 

0.14 

1.19 

-0.2 

3 

23 

5G27 

4 

0 

0 

0 

0 

0 

0 

0 

3 

24 

5G225 

* 

-1 

4635 

97 

0.88 

0.02 

0 

-0.09 

3 

24 

5G225 

1 

1 

91 

72 

1.78 

0.11 

0.96 

0.29 

3 

24 

5G225 

2 

0 

24 

19 

1.32 

0.18 

1.62 

-0.13 

3 

24 

5G225 

3 

0 

11 

9 

0.64 

0.24 

0.72 

-0.28 

3 

24 

5G225 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

25 

5G312 

* 

-1 

4636 

97 

0.88 

0.02 

0 

-0.11 

3 

25 

5G312 

1 

1 

81 

65 

2.03 

0.13 

1.07 

0.3 

3 

25 

5G312 

2 

0 

14 

11 

1.05 

0.16 

0.69 

-0.24 

3 

25 

5G312 

3 

0 

30 

24 

1.48 

0.18 

1.46 

-0.16 

3 

25 

5G312 

4 

0 

0 

0 

0 

0 

0 

0 

3 

26 

50155 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.03 

3 

26 

50155 

1 

1 

42 

81 

0.88 

0.18 

0.81 

0.51 

3 

26 

50155 

2 

0 

0 

0 

0 

0 

0 

0 

3 

26 

50155 

3 

0 

10 

19 

-0.85 

0.41 

0.59 

-0.51 

3 

26 

50155 

4 

0 

0 

0 

0 

0 

0 

0 

3 

27 

5NF511 

* 

-1 

4535 

95 

0.86 

0.02 

0 

-0.15 

3 

27 

5NF511 

1 

1 

194 

86 

1.97 

0.06 

0.92 

0.44 

3 

27 

5NF511 

2 

0 

18 

8 

0.91 

0.13 

0.64 

-0.28 

3 

27 

5NF511 

3 

0 

14 

6 

0.67 

0.2 

0.55 

-0.32 

3 

27 

5NF511 

4 

0 

0 

0 

0 

0 

0 

0 

3 

28 

50994 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.03 

3 

28 

50994 

1 

1 

32 

63 

0.88 

0.22 

1.14 

0.37 

3 

28 

50994 

2 

0 

7 

14 

-0.17 

0.33 

0.79 

-0.24 

3 

28 

50994 

3 

0 

5 

10 

0.32 

0.36 

1.18 

-0.06 

3 

28 

50994 

4 

0 

7 

14 

-0.16 

0.44 

1.1 

-0.23 

3 

29 

50271 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.07 

3 

29 

50271 

1 

1 

19 

38 

0.5 

0.21 

1.04 

0.35 

3 

29 

50271 

2 

0 

6 

12 

-0.77 

0.56 

0.75 

-0.29 

3 

29 

50271 

3 

0 

25 

50 

-0.12 

0.19 

1.13 

-0.15 

3 

29 

50271 

4 

0 

0 

0 

0 

0 

0 

0 

3 

30 

51158 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

3 

30 

51158 

1 

1 

20 

41 

1.53 

0.35 

1 

0.5 

3 

30 

51158 

2 

0 

16 

33 

0.07 

0.21 

0.74 

-0.19 

3 

30 

51158 

3 

0 

7 

14 

-0.14 

0.24 

0.55 

-0.16 

3 

30 

51158 

4 

0 

6 

12 

-0.92 

1.14 

0.81 

-0.32 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

1 

5OA230 

* 

-1 

4668 

98 

0.89 

0.02 

0 

-0.08 

4 

1 

5OA230 

1 

1 

72 

77 

1.95 

0.1 

0.89 

0.49 

4 

1 

5OA230 

2 

0 

9 

10 

1.01 

0.21 

0.78 

-0.25 

4 

1 

5OA230 

3 

0 

12 

13 

0.81 

0.15 

0.57 

-0.39 

4 

1 

5OA230 

4 

0 

0 

0 

0 

0 

0 

0 

4 

2 

50A221 

* 

-1 

4658 

98 

0.88 

0.02 

0 

-0.11 

4 

2 

50A221 

1 

1 

66 

64 

2.27 

0.13 

0.99 

0.42 

4 

2 

50A221 

2 

0 

18 

17 

1.39 

0.2 

0.92 

-0.23 

4 

2 

50A221 

3 

0 

19 

18 

1.24 

0.23 

0.89 

-0.3 

4 

2 

50A221 

4 

0 

0 

0 

0 

0 

0 

0 

4 

3 

50A327 

* 

-1 

4539 

95 

0.86 

0.02 

0 

-0.15 

4 

3 

50A327 

1 

1 

119 

54 

2.11 

0.08 

1.06 

0.36 

4 

3 

50A327 

2 

0 

33 

15 

1.2 

0.14 

0.77 

-0.27 

4 

3 

50A327 

3 

0 

70 

32 

1.55 

0.11 

1.26 

-0.18 

4 

3 

50A327 

4 

0 

0 

0 

0 

0 

0 

0 

4 

4 

50 A3 3 

* 

-1 

4666 

98 

0.88 

0.02 

0 

-0.1 

4 

4 

50 A3 3 

1 

1 

45 

47 

2.11 

0.13 

1.1 

0.26 

4 

4 

50 A3 3 

2 

0 

31 

33 

1.77 

0.17 

1.56 

-0.07 

4 

4 

50 A3 3 

3 

0 

19 

20 

1.43 

0.19 

0.9 

-0.24 

4 

4 

50 A3 3 

4 

0 

0 

0 

0 

0 

0 

0 

4 

5 

50931 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.06 

4 

5 

50931 

1 

1 

33 

67 

0.65 

0.21 

1.01 

0.46 

4 

5 

50931 

2 

0 

8 

16 

0.02 

0.23 

1.14 

-0.04 

4 

5 

50931 

3 

0 

1 

2 

-0.95 

0 

0.37 

-0.1 

4 

5 

50931 

4 

0 

7 

14 

-1.87 

0.85 

0.54 

-0.53 

4 

6 

50314 

* 

-1 

4708 

99 

0.91 

0.02 

0 

0.04 

4 

6 

50314 

1 

1 

34 

64 

0.75 

0.23 

0.93 

0.39 

4 

6 

50314 

2 

0 

12 

23 

-0.12 

0.3 

1.37 

-0.19 

4 

6 

50314 

3 

0 

1 

2 

1.11 

0 

2.92 

0.08 

4 

6 

50314 

4 

0 

6 

11 

-1.03 

0.28 

0.42 

-0.37 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

7 

50199 

* 

-1 

4707 

99 

0.91 

0.02 

0 

0.02 

4 

7 

50199 

1 

1 

35 

65 

1.17 

0.25 

0.81 

0.5 

4 

7 

50199 

2 

0 

16 

30 

-0.36 

0.27 

0.87 

-0.42 

4 

7 

50199 

3 

0 

0 

0 

0 

0 

0 

0 

4 

7 

50199 

4 

0 

3 

6 

-0.66 

0.45 

0.5 

-0.21 

4 

8 

50935 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

4 

8 

50935 

1 

1 

29 

59 

0.67 

0.2 

1.17 

0.24 

4 

8 

50935 

2 

0 

8 

16 

0.04 

0.32 

1.16 

-0.18 

4 

8 

50935 

3 

0 

8 

16 

0.13 

0.35 

1.3 

-0.14 

4 

8 

50935 

4 

0 

4 

8 

0.49 

0.4 

1.57 

0.01 

4 

9 

50920 

* 

-1 

4714 

99 

0.91 

0.02 

0 

0.06 

4 

9 

50920 

1 

1 

23 

49 

0.86 

0.26 

0.89 

0.5 

4 

9 

50920 

2 

0 

12 

26 

-0.17 

0.24 

1.01 

-0.14 

4 

9 

50920 

3 

0 

1 

2 

-1.09 

0 

0.3 

-0.13 

4 

9 

50920 

4 

0 

11 

23 

-0.84 

0.43 

0.84 

-0.4 

4 

10 

50758 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.04 

4 

10 

50758 

1 

1 

24 

49 

0.93 

0.23 

1.09 

0.43 

4 

10 

50758 

2 

0 

2 

4 

-0.67 

1.05 

0.53 

-0.14 

4 

10 

50758 

3 

0 

4 

8 

0.01 

0.37 

0.8 

-0.06 

4 

10 

50758 

4 

0 

19 

39 

-0.3 

0.37 

0.84 

-0.35 

4 

11 

5NBT612 

* 

-1 

4658 

98 

0.89 

0.02 

0 

-0.06 

4 

11 

5NBT612 

1 

1 

56 

54 

1.76 

0.12 

0.99 

0.37 

4 

11 

5NBT612 

2 

0 

26 

25 

1.17 

0.13 

0.99 

-0.19 

4 

11 

5NBT612 

3 

0 

21 

20 

1.02 

0.16 

0.88 

-0.25 

4 

11 

5NBT612 

4 

0 

0 

0 

0 

0 

0 

0 

4 

12 

50527 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.03 

4 

12 

50527 

1 

1 

41 

79 

0.79 

0.17 

1.05 

0.5 

4 

12 

50527 

2 

0 

4 

8 

-0.56 

0.53 

0.71 

-0.26 

4 

12 

50527 

3 

0 

1 

2 

-0.95 

0 

0.33 

-0.17 

4 

12 

50527 

4 

0 

6 

12 

-0.63 

0.34 

0.6 

-0.35 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

13 

50681 

* 

-1 

4711 

99 

0.9 

0.02 

0 

0.02 

4 

13 

50681 

1 

1 

35 

70 

1.27 

0.22 

0.92 

0.54 

4 

13 

50681 

2 

0 

6 

12 

-1.6 

0.99 

0.41 

-0.49 

4 

13 

50681 

3 

0 

3 

6 

-0.27 

0.52 

0.6 

-0.14 

4 

13 

50681 

4 

0 

6 

12 

-0.1 

0.43 

0.88 

-0.17 

4 

14 

50053 

* 

-1 

4700 

99 

0.9 

0.02 

0 

0 

4 

14 

50053 

1 

1 

35 

57 

1.58 

0.24 

0.99 

0.53 

4 

14 

50053 

2 

0 

6 

10 

0.15 

0.45 

0.85 

-0.18 

4 

14 

50053 

3 

0 

8 

13 

0.82 

0.15 

1.22 

-0.03 

4 

14 

50053 

4 

0 

12 

20 

-0.54 

0.19 

0.35 

-0.5 

4 

15 

50809 

* 

-1 

4714 

99 

0.91 

0.02 

0 

0.04 

4 

15 

50809 

1 

1 

17 

36 

1.47 

0.37 

0.84 

0.59 

4 

15 

50809 

2 

0 

9 

19 

-0.59 

0.28 

0.51 

-0.33 

4 

15 

50809 

3 

0 

8 

17 

-0.27 

0.29 

0.69 

-0.21 

4 

15 

50809 

4 

0 

13 

28 

-0.01 

0.26 

0.94 

-0.17 

4 

16 

5NF319 

* 

-1 

4664 

98 

0.88 

0.02 

0 

-0.1 

4 

16 

5NF319 

1 

1 

54 

56 

2.17 

0.12 

1.04 

0.38 

4 

16 

5NF319 

2 

0 

25 

26 

1.45 

0.16 

0.94 

-0.27 

4 

16 

5NF319 

3 

0 

18 

19 

1.53 

0.16 

0.95 

-0.18 

4 

16 

5NF319 

4 

0 

0 

0 

0 

0 

0 

0 

4 

17 

50711 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

4 

17 

50711 

1 

1 

44 

88 

0.52 

0.17 

1.23 

0.14 

4 

17 

50711 

2 

0 

2 

4 

0.77 

0.31 

2.2 

0.06 

4 

17 

50711 

3 

0 

1 

2 

0.43 

0 

1.48 

-0.01 

4 

17 

50711 

4 

0 

3 

6 

-0.54 

0.27 

0.6 

-0.23 

4 

18 

50126 

* 

-1 

4473 

94 

0.86 

0.02 

0 

-0.13 

4 

18 

50126 

1 

1 

262 

91 

1.69 

0.06 

1.06 

0.29 

4 

18 

50126 

2 

0 

13 

5 

0.95 

0.26 

1.24 

-0.13 

4 

18 

50126 

3 

0 

13 

5 

0.28 

0.33 

0.75 

-0.26 

4 

18 

50126 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

19 

50428 

* 

-1 

4708 

99 

0.91 

0.02 

0 

0.03 

4 

19 

50428 

1 

1 

33 

62 

1.04 

0.17 

0.75 

0.62 

4 

19 

50428 

2 

0 

12 

23 

-0.5 

0.24 

0.6 

-0.44 

4 

19 

50428 

3 

0 

2 

4 

-1.6 

0.81 

0.2 

-0.34 

4 

19 

50428 

4 

0 

6 

11 

-0.05 

0.36 

0.94 

-0.15 

4 

20 

51172 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

4 

20 

51172 

1 

1 

28 

56 

1.18 

0.22 

0.92 

0.57 

4 

20 

51172 

2 

0 

5 

10 

-0.53 

0.31 

0.45 

-0.31 

4 

20 

51172 

3 

0 

8 

16 

0.12 

0.29 

0.91 

-0.16 

4 

20 

51172 

4 

0 

9 

18 

-0.3 

0.23 

0.56 

-0.34 

4 

21 

5MD411 

* 

-1 

4666 

98 

0.89 

0.02 

0 

-0.06 

4 

21 

5MD411 

1 

1 

60 

63 

1.8 

0.14 

0.93 

0.45 

4 

21 

5MD411 

2 

0 

15 

16 

0.88 

0.15 

0.78 

-0.24 

4 

21 

5MD411 

3 

0 

20 

21 

0.82 

0.13 

0.74 

-0.32 

4 

21 

5MD411 

4 

0 

0 

0 

0 

0 

0 

0 

4 

22 

51164 

* 

-1 

4694 

99 

0.9 

0.02 

0 

-0.01 

4 

22 

51164 

1 

1 

28 

42 

2.01 

0.21 

0.63 

0.66 

4 

22 

51164 

2 

0 

2 

3 

0.28 

0.08 

0.46 

-0.11 

4 

22 

51164 

3 

0 

9 

13 

0.49 

0.27 

0.76 

-0.18 

4 

22 

51164 

4 

0 

28 

42 

0.31 

0.16 

0.67 

-0.5 

4 

23 

5G220 

* 

-1 

4650 

98 

0.88 

0.02 

0 

-0.09 

4 

23 

5G220 

1 

1 

88 

79 

1.94 

0.09 

0.87 

0.45 

4 

23 

5G220 

2 

0 

20 

18 

0.9 

0.22 

0.88 

-0.41 

4 

23 

5G220 

3 

0 

3 

3 

0.91 

0.43 

0.66 

-0.14 

4 

23 

5G220 

4 

0 

0 

0 

0 

0 

0 

0 

4 

24 

5G320 

* 

-1 

4660 

98 

0.87 

0.02 

0 

-0.17 

4 

24 

5G320 

1 

1 

84 

83 

2.53 

0.13 

1.11 

0.21 

4 

24 

5G320 

2 

0 

11 

11 

1.76 

0.28 

1.01 

-0.2 

4 

24 

5G320 

3 

0 

6 

6 

2.12 

0.27 

1.26 

-0.07 

4 

24 

5G320 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

25 

5G29 

* 

-1 

4649 

98 

0.88 

0.02 

0 

-0.09 

4 

25 

5G29 

1 

1 

71 

63 

2.11 

0.14 

0.99 

0.45 

4 

25 

5G29 

2 

0 

30 

27 

1.01 

0.16 

0.87 

-0.35 

4 

25 

5G29 

3 

0 

11 

10 

0.96 

0.28 

0.81 

-0.2 

4 

25 

5G29 

4 

0 

0 

0 

0 

0 

0 

0 

4 

26 

50302 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.05 

4 

26 

50302 

1 

1 

39 

76 

0.64 

0.17 

0.76 

0.55 

4 

26 

50302 

2 

0 

4 

8 

-0.18 

0.5 

1.43 

-0.1 

4 

26 

50302 

3 

0 

7 

14 

-1.35 

0.35 

0.46 

-0.51 

4 

26 

50302 

4 

0 

1 

2 

-1.76 

0 

0.19 

-0.23 

4 

27 

50492 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.02 

4 

27 

50492 

1 

1 

33 

67 

0.84 

0.2 

1.25 

0.31 

4 

27 

50492 

2 

0 

6 

12 

-0.08 

0.43 

0.86 

-0.21 

4 

27 

50492 

3 

0 

4 

8 

0.56 

0.65 

1.82 

-0.01 

4 

27 

50492 

4 

0 

6 

12 

-0.14 

0.46 

0.97 

-0.23 

4 

28 

50355 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.03 

4 

28 

50355 

1 

1 

32 

63 

0.84 

0.17 

0.96 

0.44 

4 

28 

50355 

2 

0 

7 

14 

-0.05 

0.43 

0.97 

-0.19 

4 

28 

50355 

3 

0 

10 

20 

-0.12 

0.3 

1.03 

-0.27 

4 

28 

50355 

4 

0 

2 

4 

-0.58 

0.45 

0.44 

-0.2 

4 

29 

5MD45 

* 

-1 

4637 

97 

0.88 

0.02 

0 

-0.08 

4 

29 

5MD45 

1 

1 

84 

68 

1.83 

0.12 

1.02 

0.33 

4 

29 

5MD45 

2 

0 

4 

3 

0.74 

0.28 

0.59 

-0.15 

4 

29 

5MD45 

3 

0 

36 

29 

1.14 

0.1 

0.92 

-0.28 

4 

29 

5MD45 

4 

0 

0 

0 

0 

0 

0 

0 

4 

30 

51046 

* 

-1 

4714 

99 

0.9 

0.02 

0 

0.02 

4 

30 

51046 

1 

1 

19 

40 

1.56 

0.38 

1.01 

0.55 

4 

30 

51046 

2 

0 

17 

36 

0.25 

0.15 

0.87 

-0.22 

4 

30 

51046 

3 

0 

6 

13 

-0.21 

0.28 

0.55 

-0.24 

4 

30 

51046 

4 

0 

5 

11 

-0.37 

0.32 

0.45 

-0.26 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

1 

50A323 

* 

-1 

4661 

98 

0.88 

0.02 

0 

-0.1 

5 

1 

50A323 

1 

1 

76 

76 

1.95 

0.13 

1.06 

0.26 

5 

1 

50A323 

2 

0 

7 

7 

1.13 

0.41 

1.27 

-0.15 

5 

1 

50A323 

3 

0 

17 

17 

1.29 

0.24 

1.52 

-0.19 

5 

1 

50A323 

4 

0 

0 

0 

0 

0 

0 

0 

5 

2 

50A318 

* 

-1 

4664 

98 

0.87 

0.02 

0 

-0.16 

5 

2 

50A318 

1 

1 

70 

72 

2.81 

0.13 

0.86 

0.52 

5 

2 

50A318 

2 

0 

8 

8 

1.21 

0.15 

0.41 

-0.32 

5 

2 

50A318 

3 

0 

19 

20 

1.57 

0.21 

0.77 

-0.37 

5 

2 

50A318 

4 

0 

0 

0 

0 

0 

0 

0 

5 

3 

50A223 

* 

-1 

4661 

98 

0.89 

0.02 

0 

-0.06 

5 

3 

50A223 

1 

1 

46 

46 

1.88 

0.14 

0.97 

0.44 

5 

3 

50A223 

2 

0 

22 

22 

1.31 

0.14 

1.05 

-0.09 

5 

3 

50A223 

3 

0 

32 

32 

0.96 

0.11 

0.73 

-0.39 

5 

3 

50A223 

4 

0 

0 

0 

0 

0 

0 

0 

5 

4 

5OA310 

* 

-1 

4539 

95 

0.87 

0.02 

0 

-0.1 

5 

4 

5OA310 

1 

1 

86 

39 

2.03 

0.14 

1.21 

0.39 

5 

4 

5OA310 

2 

0 

127 

57 

1.15 

0.08 

0.99 

-0.35 

5 

4 

5OA310 

3 

0 

9 

4 

1.04 

0.21 

0.72 

-0.08 

5 

4 

5OA310 

4 

0 

0 

0 

0 

0 

0 

0 

5 

5 

50164 

* 

-1 

4710 

99 

0.9 

0.02 

0 

0 

5 

5 

50164 

1 

1 

39 

76 

1.17 

0.22 

0.96 

0.39 

5 

5 

50164 

2 

0 

2 

4 

-0.73 

0.67 

0.39 

-0.24 

5 

5 

50164 

3 

0 

4 

8 

0.68 

0.29 

1.44 

-0.04 

5 

5 

50164 

4 

0 

6 

12 

-0.34 

0.2 

0.51 

-0.33 

5 

6 

5NBT314 

* 

-1 

4658 

98 

0.89 

0.02 

0 

-0.05 

5 

6 

5NBT314 

1 

1 

85 

83 

1.55 

0.12 

0.97 

0.34 

5 

6 

5NBT314 

2 

0 

13 

13 

0.7 

0.21 

0.9 

-0.24 

5 

6 

5NBT314 

3 

0 

5 

5 

0.38 

0.18 

0.53 

-0.21 

5 

6 

5NBT314 

4 

0 

0 

0 

0 

0 

0 

0 



easyCBM CCSS Fifth Grade Math Measure Development 


110 

Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

7 

50025 

* 

-1 

4697 

99 

0.9 

0.02 

0 

0.01 

5 

7 

50025 

1 

1 

43 

67 

1.37 

0.21 

0.89 

0.55 

5 

7 

50025 

2 

0 

8 

13 

-0.3 

0.37 

0.76 

-0.29 

5 

7 

50025 

3 

0 

5 

8 

-0.06 

0.34 

0.78 

-0.17 

5 

7 

50025 

4 

0 

8 

13 

-0.54 

0.36 

0.59 

-0.35 

5 

8 

50796 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

5 

8 

50796 

1 

1 

30 

61 

0.98 

0.21 

1.22 

0.46 

5 

8 

50796 

2 

0 

14 

29 

-0.04 

0.25 

1.08 

-0.32 

5 

8 

50796 

3 

0 

3 

6 

-0.15 

0.32 

0.65 

-0.15 

5 

8 

50796 

4 

0 

2 

4 

-0.68 

0.92 

0.5 

-0.22 

5 

9 

5NBT514 

* 

-1 

4652 

98 

0.88 

0.02 

0 

-0.12 

5 

9 

5NBT514 

1 

1 

88 

81 

2.18 

0.11 

0.97 

0.49 

5 

9 

5NBT514 

2 

0 

15 

14 

1 

0.15 

0.65 

-0.35 

5 

9 

5NBT514 

3 

0 

6 

6 

0.49 

0.12 

0.34 

-0.32 

5 

9 

5NBT514 

4 

0 

0 

0 

0 

0 

0 

0 

5 

10 

5NBT22 

* 

-1 

4637 

97 

0.88 

0.02 

0 

-0.08 

5 

10 

5NBT22 

1 

1 

90 

73 

1.82 

0.12 

1 

0.37 

5 

10 

5NBT22 

2 

0 

16 

13 

0.98 

0.11 

0.74 

-0.23 

5 

10 

5NBT22 

3 

0 

18 

15 

0.97 

0.09 

0.71 

-0.25 

5 

10 

5NBT22 

4 

0 

0 

0 

0 

0 

0 

0 

5 

11 

50918 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

5 

11 

50918 

1 

1 

18 

37 

1.46 

0.27 

0.73 

0.59 

5 

11 

50918 

2 

0 

3 

6 

-0.19 

0.59 

0.62 

-0.15 

5 

11 

50918 

3 

0 

12 

24 

-0.16 

0.27 

0.66 

-0.31 

5 

11 

50918 

4 

0 

16 

33 

0.08 

0.22 

0.83 

-0.25 

5 

12 

50665 

* 

-1 

4709 

99 

0.9 

0.02 

0 

0.02 

5 

12 

50665 

1 

1 

42 

81 

0.94 

0.22 

0.97 

0.34 

5 

12 

50665 

2 

0 

3 

6 

-0.12 

0.3 

0.78 

-0.15 

5 

12 

50665 

3 

0 

7 

13 

-0.29 

0.28 

0.8 

-0.29 

5 

12 

50665 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

13 

50080 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.03 

5 

13 

50080 

1 

1 

36 

71 

0.75 

0.16 

1.15 

0.31 

5 

13 

50080 

2 

0 

5 

10 

-0.11 

0.46 

0.79 

-0.23 

5 

13 

50080 

3 

0 

4 

8 

0.38 

0.2 

1.05 

-0.05 

5 

13 

50080 

4 

0 

6 

12 

0.08 

0.38 

0.96 

-0.18 

5 

14 

50381 

* 

-1 

4706 

99 

0.91 

0.02 

0 

0.03 

5 

14 

50381 

1 

1 

27 

49 

0.83 

0.2 

1.03 

0.34 

5 

14 

50381 

2 

0 

25 

45 

0.18 

0.19 

1.15 

-0.26 

5 

14 

50381 

3 

0 

2 

4 

-0.87 

0.42 

0.29 

-0.25 

5 

14 

50381 

4 

0 

1 

2 

0.67 

0 

1.24 

0.03 

5 

15 

50529 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.04 

5 

15 

50529 

1 

1 

18 

36 

1.01 

0.22 

0.8 

0.45 

5 

15 

50529 

2 

0 

6 

12 

-0.02 

0.35 

0.73 

-0.16 

5 

15 

50529 

3 

0 

22 

44 

0.24 

0.18 

1.06 

-0.16 

5 

15 

50529 

4 

0 

4 

8 

-0.63 

0.44 

0.42 

-0.31 

5 

16 

5NF34 

* 

-1 

4662 

98 

0.89 

0.02 

0 

-0.05 

5 

16 

5NF34 

1 

1 

44 

44 

1.88 

0.15 

0.98 

0.44 

5 

16 

5NF34 

2 

0 

22 

22 

0.97 

0.18 

1.15 

-0.2 

5 

16 

5NF34 

3 

0 

33 

33 

0.93 

0.17 

1.74 

-0.29 

5 

16 

5NF34 

4 

0 

0 

0 

0 

0 

0 

0 

5 

17 

50280 

* 

-1 

4492 

94 

0.87 

0.02 

0 

-0.09 

5 

17 

50280 

1 

1 

253 

94 

1.5 

0.07 

0.92 

0.33 

5 

17 

50280 

2 

0 

2 

1 

-1.26 

0.03 

0.12 

-0.2 

5 

17 

50280 

3 

0 

13 

5 

0.01 

0.27 

0.56 

-0.27 

5 

17 

50280 

4 

0 

1 

0 

0.11 

0 

0.46 

-0.07 

5 

18 

50573 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.02 

5 

18 

50573 

1 

1 

41 

79 

0.94 

0.21 

0.96 

0.43 

5 

18 

50573 

2 

0 

4 

8 

-0.45 

0.54 

0.86 

-0.22 

5 

18 

50573 

3 

0 

1 

2 

0.15 

0 

1.03 

-0.05 

5 

18 

50573 

4 

0 

6 

12 

-0.71 

0.3 

0.57 

-0.35 



easyCBM CCSS Fifth Grade Math Measure Development 


112 

Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

19 

51171 

* 

-1 

4487 

94 

0.88 

0.02 

0 

-0.06 

5 

19 

51171 

1 

1 

201 

73 

1.5 

0.08 

0.99 

0.37 

5 

19 

51171 

2 

0 

35 

13 

0.76 

0.1 

1 

-0.15 

5 

19 

51171 

3 

0 

30 

11 

0.54 

0.14 

0.92 

-0.2 

5 

19 

51171 

4 

0 

8 

3 

-0.87 

0.42 

0.25 

-0.3 

5 

20 

50139 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

5 

20 

50139 

1 

1 

27 

54 

1.1 

0.23 

0.81 

0.54 

5 

20 

50139 

2 

0 

14 

28 

0.18 

0.22 

1.25 

-0.14 

5 

20 

50139 

3 

0 

2 

4 

-0.42 

0.12 

0.48 

-0.14 

5 

20 

50139 

4 

0 

7 

14 

-1.13 

0.26 

0.3 

-0.51 

5 

21 

5MD58 

* 

-1 

4666 

98 

0.91 

0.02 

0 

0.02 

5 

21 

5MD58 

1 

1 

46 

48 

1.13 

0.12 

0.88 

0.47 

5 

21 

5MD58 

2 

0 

31 

33 

0.27 

0.1 

0.72 

-0.43 

5 

21 

5MD58 

3 

0 

18 

19 

0.63 

0.14 

1.04 

-0.08 

5 

21 

5MD58 

4 

0 

0 

0 

0 

0 

0 

0 

5 

22 

5MD214 

* 

-1 

4666 

98 

0.91 

0.02 

0 

0.02 

5 

22 

5MD214 

1 

1 

33 

35 

1.05 

0.18 

1.2 

0.27 

5 

22 

5MD214 

2 

0 

45 

47 

0.62 

0.08 

0.94 

-0.17 

5 

22 

5MD214 

3 

0 

17 

18 

0.55 

0.16 

0.93 

-0.12 

5 

22 

5MD214 

4 

0 

0 

0 

0 

0 

0 

0 

5 

23 

5G25 

* 

-1 

4646 

98 

0.88 

0.02 

0 

-0.12 

5 

23 

5G25 

1 

1 

98 

85 

2.05 

0.1 

1.01 

0.28 

5 

23 

5G25 

2 

0 

15 

13 

1.31 

0.26 

1.16 

-0.22 

5 

23 

5G25 

3 

0 

2 

2 

0.43 

0.26 

0.33 

-0.19 

5 

23 

5G25 

4 

0 

0 

0 

0 

0 

0 

0 

5 

24 

5G121 

* 

-1 

4657 

98 

0.89 

0.02 

0 

-0.05 

5 

24 

5G121 

1 

1 

69 

66 

1.65 

0.13 

1.11 

0.34 

5 

24 

5G121 

2 

0 

20 

19 

0.92 

0.18 

1.09 

-0.2 

5 

24 

5G121 

3 

0 

15 

14 

0.72 

0.32 

0.99 

-0.24 

5 

24 

5G121 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

25 

5G424 

* 

-1 

4648 

98 

0.88 

0.02 

0 

-0.11 

5 

25 

5G424 

1 

1 

79 

70 

2.15 

0.1 

0.92 

0.45 

5 

25 

5G424 

2 

0 

15 

13 

1.32 

0.19 

0.84 

-0.24 

5 

25 

5G424 

3 

0 

19 

17 

1.2 

0.16 

0.74 

-0.34 

5 

25 

5G424 

4 

0 

0 

0 

0 

0 

0 

0 

5 

26 

50309 

* 

-1 

4708 

99 

0.91 

0.02 

0 

0.03 

5 

26 

50309 

1 

1 

43 

81 

0.7 

0.16 

0.99 

0.39 

5 

26 

50309 

2 

0 

4 

8 

-0.06 

0.35 

0.93 

-0.14 

5 

26 

50309 

3 

0 

3 

6 

-0.57 

0.35 

0.53 

-0.24 

5 

26 

50309 

4 

0 

3 

6 

-0.66 

0.68 

0.69 

-0.26 

5 

27 

50400 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.04 

5 

27 

50400 

1 

1 

33 

63 

0.79 

0.19 

0.95 

0.47 

5 

27 

50400 

2 

0 

3 

6 

-0.48 

0.1 

0.52 

-0.18 

5 

27 

50400 

3 

0 

12 

23 

-0.03 

0.33 

1.26 

-0.19 

5 

27 

50400 

4 

0 

4 

8 

-1.24 

0.21 

0.26 

-0.39 

5 

28 

50368 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.02 

5 

28 

50368 

1 

1 

34 

65 

0.96 

0.18 

0.99 

0.45 

5 

28 

50368 

2 

0 

14 

27 

0.04 

0.27 

0.91 

-0.3 

5 

28 

50368 

3 

0 

1 

2 

-1.07 

0 

0.22 

-0.21 

5 

28 

50368 

4 

0 

3 

6 

-0.42 

0.48 

0.52 

-0.23 

5 

29 

5MD211 

* 

-1 

4656 

98 

0.89 

0.02 

0 

-0.06 

5 

29 

5MD211 

1 

1 

69 

66 

1.64 

0.11 

1.02 

0.31 

5 

29 

5MD211 

2 

0 

28 

27 

1.1 

0.12 

0.99 

-0.24 

5 

29 

5MD211 

3 

0 

8 

8 

0.97 

0.28 

0.89 

-0.16 

5 

29 

5MD211 

4 

0 

0 

0 

0 

0 

0 

0 

5 

30 

5MD116 

* 

-1 

4649 

98 

0.88 

0.02 

0 

-0.11 

5 

30 

5MD116 

1 

1 

77 

69 

2.05 

0.1 

1.05 

0.3 

5 

30 

5MD116 

2 

0 

21 

19 

1.33 

0.18 

0.93 

-0.28 

5 

30 

5MD116 

3 

0 

14 

13 

1.64 

0.22 

1.25 

-0.09 

5 

30 

5MD116 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

1 

50A125 

* 

-1 

4661 

98 

0.89 

0.02 

0 

-0.06 

6 

1 

50A125 

1 

1 

72 

72 

1.7 

0.11 

0.95 

0.43 

6 

1 

50A125 

2 

0 

12 

12 

0.75 

0.13 

0.63 

-0.3 

6 

1 

50A125 

3 

0 

16 

16 

0.93 

0.13 

0.78 

-0.26 

6 

1 

50A125 

4 

0 

0 

0 

0 

0 

0 

0 

6 

2 

50A25 

* 

-1 

4645 

98 

0.89 

0.02 

0 

-0.07 

6 

2 

50A25 

1 

1 

63 

54 

1.94 

0.15 

0.96 

0.46 

6 

2 

50A25 

2 

0 

29 

25 

0.94 

0.13 

0.84 

-0.27 

6 

2 

50A25 

3 

0 

24 

21 

0.87 

0.13 

0.78 

-0.27 

6 

2 

50A25 

4 

0 

0 

0 

0 

0 

0 

0 

6 

3 

5OA320 

* 

-1 

4658 

98 

0.88 

0.02 

0 

-0.11 

6 

3 

5OA320 

1 

1 

60 

58 

2.24 

0.14 

1.19 

0.34 

6 

3 

5OA320 

2 

0 

19 

18 

1.23 

0.22 

0.82 

-0.3 

6 

3 

5OA320 

3 

0 

24 

23 

1.7 

0.17 

1.17 

-0.11 

6 

3 

5OA320 

4 

0 

0 

0 

0 

0 

0 

0 

6 

4 

50A134 

* 

-1 

4664 

98 

0.87 

0.02 

0 

-0.16 

6 

4 

50A134 

1 

1 

56 

58 

2.87 

0.15 

1.04 

0.44 

6 

4 

50A134 

2 

0 

7 

7 

1.53 

0.3 

0.59 

-0.22 

6 

4 

50A134 

3 

0 

34 

35 

1.9 

0.15 

0.93 

-0.34 

6 

4 

50A134 

4 

0 

0 

0 

0 

0 

0 

0 

6 

5 

50792 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.03 

6 

5 

50792 

1 

1 

34 

71 

0.8 

0.22 

0.94 

0.42 

6 

5 

50792 

2 

0 

2 

4 

-0.09 

0.32 

0.83 

-0.09 

6 

5 

50792 

3 

0 

10 

21 

-0.31 

0.3 

0.89 

-0.31 

6 

5 

50792 

4 

0 

2 

4 

-0.87 

0.12 

0.36 

-0.22 

6 

6 

50937 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.06 

6 

6 

50937 

1 

1 

29 

60 

0.65 

0.25 

1.01 

0.46 

6 

6 

50937 

2 

0 

1 

2 

-0.71 

0 

0.5 

-0.08 

6 

6 

50937 

3 

0 

7 

15 

-0.46 

0.36 

0.94 

-0.15 

6 

6 

50937 

4 

0 

11 

23 

-0.96 

0.51 

0.8 

-0.38 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

7 

51075 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.04 

6 

7 

51075 

1 

1 

30 

61 

0.74 

0.25 

1.01 

0.37 

6 

7 

51075 

2 

0 

7 

14 

-0.54 

0.19 

0.59 

-0.29 

6 

7 

51075 

3 

0 

11 

22 

0.05 

0.31 

1.55 

-0.13 

6 

7 

51075 

4 

0 

1 

2 

-1.29 

0 

0.24 

-0.19 

6 

8 

50013 

* 

-1 

1948 

41 

1.46 

0.03 

0 

0.34 

6 

8 

50013 

1 

1 

1689 

60 

1.05 

0.03 

0.93 

0.5 

6 

8 

50013 

2 

0 

409 

15 

-0.11 

0.04 

0.95 

-0.2 

6 

8 

50013 

3 

0 

411 

15 

-0.18 

0.05 

0.94 

-0.22 

6 

8 

50013 

4 

0 

304 

11 

-0.65 

0.07 

0.63 

-0.31 

6 

9 

50338 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.03 

6 

9 

50338 

1 

1 

30 

58 

1.16 

0.18 

0.8 

0.56 

6 

9 

50338 

2 

0 

7 

13 

0.38 

0.47 

2.3 

-0.06 

6 

9 

50338 

3 

0 

5 

10 

-0.04 

0.37 

0.77 

-0.16 

6 

9 

50338 

4 

0 

10 

19 

-0.79 

0.36 

0.43 

-0.53 

6 

10 

51071 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

6 

10 

51071 

1 

1 

25 

50 

1.44 

0.26 

0.62 

0.62 

6 

10 

51071 

2 

0 

8 

16 

0.44 

0.25 

1.39 

-0.02 

6 

10 

51071 

3 

0 

8 

16 

-1.13 

0.26 

0.29 

-0.47 

6 

10 

51071 

4 

0 

9 

18 

-0.62 

0.4 

0.77 

-0.34 

6 

11 

50473 

* 

-1 

4701 

99 

0.91 

0.02 

0 

0.04 

6 

11 

50473 

1 

1 

22 

37 

1.34 

0.22 

0.8 

0.54 

6 

11 

50473 

2 

0 

18 

30 

0.24 

0.23 

1.05 

-0.12 

6 

11 

50473 

3 

0 

6 

10 

0.48 

0.44 

1.46 

0.01 

6 

11 

50473 

4 

0 

14 

23 

-0.66 

0.29 

0.46 

-0.49 

6 

12 

50398 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.03 

6 

12 

50398 

1 

1 

41 

79 

0.74 

0.17 

0.93 

0.38 

6 

12 

50398 

2 

0 

7 

13 

0.05 

0.42 

1.46 

-0.17 

6 

12 

50398 

3 

0 

2 

4 

-0.97 

0.13 

0.32 

-0.27 

6 

12 

50398 

4 

0 

2 

4 

-0.78 

0.25 

0.39 

-0.23 



easyCBM CCSS Fifth Grade Math Measure Development 


116 

Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

13 

50229 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.04 

6 

13 

50229 

1 

1 

31 

65 

0.88 

0.18 

0.71 

0.57 

6 

13 

50229 

2 

0 

10 

21 

-0.57 

0.41 

1.23 

-0.38 

6 

13 

50229 

3 

0 

2 

4 

-0.18 

0.15 

0.74 

-0.09 

6 

13 

50229 

4 

0 

5 

10 

-0.84 

0.37 

0.5 

-0.33 

6 

14 

50672 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.04 

6 

14 

50672 

1 

1 

24 

48 

0.73 

0.14 

0.92 

0.49 

6 

14 

50672 

2 

0 

10 

20 

0.25 

0.16 

1.01 

-0.05 

6 

14 

50672 

3 

0 

12 

24 

-0.12 

0.22 

0.79 

-0.33 

6 

14 

50672 

4 

0 

4 

8 

-0.45 

0.27 

0.49 

-0.3 

6 

15 

50807 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.04 

6 

15 

50807 

1 

1 

18 

38 

1.4 

0.28 

0.87 

0.62 

6 

15 

50807 

2 

0 

16 

33 

-0.1 

0.18 

0.69 

-0.31 

6 

15 

50807 

3 

0 

2 

4 

-0.74 

0.8 

0.37 

-0.2 

6 

15 

50807 

4 

0 

12 

25 

-0.1 

0.25 

0.7 

-0.26 

6 

16 

5NF47 

* 

-1 

4638 

97 

0.88 

0.02 

0 

-0.08 

6 

16 

5NF47 

1 

1 

61 

50 

2.08 

0.14 

0.87 

0.5 

6 

16 

5NF47 

2 

0 

39 

32 

0.93 

0.08 

0.65 

-0.43 

6 

16 

5NF47 

3 

0 

23 

19 

1.31 

0.11 

0.95 

-0.12 

6 

16 

5NF47 

4 

0 

0 

0 

0 

0 

0 

0 

6 

17 

50437 

* 

-1 

4707 

99 

0.91 

0.02 

0 

0.05 

6 

17 

50437 

1 

1 

46 

85 

0.45 

0.14 

0.84 

0.48 

6 

17 

50437 

2 

0 

3 

6 

-1.4 

0.74 

0.43 

-0.36 

6 

17 

50437 

3 

0 

4 

7 

-0.7 

0.58 

0.8 

-0.24 

6 

17 

50437 

4 

0 

1 

2 

-1.3 

0 

0.31 

-0.19 

6 

18 

50401 

* 

-1 

4707 

99 

0.91 

0.02 

0 

0.03 

6 

18 

50401 

1 

1 

43 

80 

0.7 

0.2 

1.11 

0.21 

6 

18 

50401 

2 

0 

9 

17 

0.25 

0.25 

1.35 

-0.11 

6 

18 

50401 

3 

0 

2 

4 

-0.99 

1.13 

0.53 

-0.24 

6 

18 

50401 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

19 

50431 

* 

-1 

4466 

94 

0.86 

0.02 

0 

-0.11 

6 

19 

50431 

1 

1 

229 

78 

1.82 

0.07 

0.85 

0.5 

6 

19 

50431 

2 

0 

47 

16 

0.22 

0.14 

0.6 

-0.44 

6 

19 

50431 

3 

0 

14 

5 

0.78 

0.17 

0.83 

-0.13 

6 

19 

50431 

4 

0 

5 

2 

-0.31 

0.82 

0.67 

-0.19 

6 

20 

5MD47 

* 

-1 

4652 

98 

0.88 

0.02 

0 

-0.12 

6 

20 

5MD47 

1 

1 

88 

81 

2.19 

0.11 

0.93 

0.51 

6 

20 

5MD47 

2 

0 

3 

3 

0.99 

0.38 

0.62 

-0.15 

6 

20 

5MD47 

3 

0 

18 

17 

0.79 

0.14 

0.52 

-0.47 

6 

20 

5MD47 

4 

0 

0 

0 

0 

0 

0 

0 

6 

21 

5MD117 

* 

-1 

4664 

98 

0.89 

0.02 

0 

-0.09 

6 

21 

5MD117 

1 

1 

67 

69 

1.92 

0.11 

1.04 

0.33 

6 

21 

5MD117 

2 

0 

21 

22 

1.26 

0.17 

0.99 

-0.28 

6 

21 

5MD117 

3 

0 

9 

9 

1.37 

0.16 

0.89 

-0.13 

6 

21 

5MD117 

4 

0 

0 

0 

0 

0 

0 

0 

6 

22 

5MD113 

* 

-1 

4650 

98 

0.88 

0.02 

0 

-0.11 

6 

22 

5MD113 

1 

1 

63 

57 

2.15 

0.16 

1.19 

0.31 

6 

22 

5MD113 

2 

0 

24 

22 

1.28 

0.13 

0.8 

-0.27 

6 

22 

5MD113 

3 

0 

24 

22 

1.63 

0.18 

1.38 

-0.1 

6 

22 

5MD113 

4 

0 

0 

0 

0 

0 

0 

0 

6 

23 

5G419 

* 

-1 

4548 

96 

0.9 

0.02 

0 

-0.02 

6 

23 

5G419 

1 

1 

143 

67 

1.23 

0.08 

0.99 

0.33 

6 

23 

5G419 

2 

0 

23 

11 

0.26 

0.17 

0.8 

-0.28 

6 

23 

5G419 

3 

0 

47 

22 

0.73 

0.1 

1.12 

-0.16 

6 

23 

5G419 

4 

0 

0 

0 

0 

0 

0 

0 

6 

24 

5G321 

* 

-1 

4636 

97 

0.88 

0.02 

0 

-0.09 

6 

24 

5G321 

1 

1 

88 

70 

1.78 

0.12 

1.02 

0.26 

6 

24 

5G321 

2 

0 

23 

18 

1.18 

0.14 

1 

-0.19 

6 

24 

5G321 

3 

0 

14 

11 

1.2 

0.24 

1.29 

-0.14 

6 

24 

5G321 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

25 

5G45 

* 

-1 

4637 

97 

0.88 

0.02 

0 

-0.08 

6 

25 

5G45 

1 

1 

80 

65 

1.79 

0.13 

1.1 

0.26 

6 

25 

5G45 

2 

0 

18 

15 

1.01 

0.12 

0.74 

-0.23 

6 

25 

5G45 

3 

0 

26 

21 

1.38 

0.14 

1.27 

-0.1 

6 

25 

5G45 

4 

0 

0 

0 

0 

0 

0 

0 

6 

26 

51054 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.05 

6 

26 

51054 

1 

1 

40 

77 

0.71 

0.21 

1.1 

0.48 

6 

26 

51054 

2 

0 

3 

6 

-1.11 

0.68 

0.45 

-0.23 

6 

26 

51054 

3 

0 

5 

10 

-0.47 

0.41 

0.88 

-0.16 

6 

26 

51054 

4 

0 

4 

8 

-1.7 

1.29 

0.66 

-0.37 

6 

27 

50550 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.04 

6 

27 

50550 

1 

1 

31 

62 

0.72 

0.22 

1.03 

0.44 

6 

27 

50550 

2 

0 

4 

8 

-0.34 

0.16 

0.64 

-0.18 

6 

27 

50550 

3 

0 

9 

18 

-0.33 

0.21 

0.73 

-0.28 

6 

27 

50550 

4 

0 

6 

12 

-0.25 

0.18 

0.72 

-0.19 

6 

28 

50383 

* 

-1 

4711 

99 

0.9 

0.02 

0 

0.02 

6 

28 

50383 

1 

1 

32 

64 

1.17 

0.22 

0.88 

0.52 

6 

28 

50383 

2 

0 

16 

32 

-0.12 

0.18 

0.7 

-0.41 

6 

28 

50383 

3 

0 

0 

0 

0 

0 

0 

0 

6 

28 

50383 

4 

0 

2 

4 

-1.3 

1.79 

0.55 

-0.3 

6 

29 

51031 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.05 

6 

29 

51031 

1 

1 

21 

42 

0.76 

0.25 

1.09 

0.44 

6 

29 

51031 

2 

0 

21 

42 

-0.21 

0.15 

0.77 

-0.36 

6 

29 

51031 

3 

0 

3 

6 

0.82 

0.55 

2.39 

0.14 

6 

29 

51031 

4 

0 

5 

10 

-0.57 

0.39 

0.57 

-0.26 

6 

30 

5MD52 

* 

-1 

4640 

97 

0.89 

0.02 

0 

-0.07 

6 

30 

5MD52 

1 

1 

69 

57 

2.05 

0.13 

0.72 

0.61 

6 

30 

5MD52 

2 

0 

30 

25 

0.52 

0.09 

0.52 

-0.47 

6 

30 

5MD52 

3 

0 

22 

18 

0.85 

0.14 

0.8 

-0.25 

6 

30 

5MD52 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

1 

50A324 

* 

-1 

4650 

98 

0.89 

0.02 

0 

-0.04 

7 

1 

50A324 

1 

1 

74 

67 

1.58 

0.12 

0.88 

0.49 

7 

1 

50A324 

2 

0 

10 

9 

0.41 

0.24 

0.69 

-0.25 

7 

1 

50A324 

3 

0 

27 

24 

0.55 

0.13 

0.74 

-0.37 

7 

1 

50A324 

4 

0 

0 

0 

0 

0 

0 

0 

7 

2 

50A317 

* 

-1 

4662 

98 

0.89 

0.02 

0 

-0.05 

7 

2 

50A317 

1 

1 

52 

53 

1.81 

0.15 

0.98 

0.45 

7 

2 

50A317 

2 

0 

22 

22 

1.08 

0.2 

1.48 

-0.14 

7 

2 

50A317 

3 

0 

25 

25 

0.67 

0.11 

0.64 

-0.38 

7 

2 

50A317 

4 

0 

0 

0 

0 

0 

0 

0 

7 

3 

50 A3 7 

* 

-1 

4668 

98 

0.89 

0.02 

0 

-0.06 

7 

3 

50 A3 7 

1 

1 

45 

48 

1.81 

0.18 

1.13 

0.33 

7 

3 

50 A3 7 

2 

0 

28 

30 

1.01 

0.12 

0.83 

-0.28 

7 

3 

50 A3 7 

3 

0 

20 

22 

1.27 

0.17 

1.17 

-0.09 

7 

3 

50 A3 7 

4 

0 

0 

0 

0 

0 

0 

0 

7 

4 

50A124 

* 

-1 

4668 

98 

0.89 

0.02 

0 

-0.06 

7 

4 

50A124 

1 

1 

37 

40 

1.88 

0.21 

1.17 

0.34 

7 

4 

50A124 

2 

0 

21 

23 

1.33 

0.14 

1.07 

-0.07 

7 

4 

50A124 

3 

0 

35 

38 

1.07 

0.13 

0.91 

-0.29 

7 

4 

50A124 

4 

0 

0 

0 

0 

0 

0 

0 

7 

5 

50793 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.04 

7 

5 

50793 

1 

1 

34 

69 

0.77 

0.23 

1.26 

0.42 

7 

5 

50793 

2 

0 

8 

16 

-0.37 

0.34 

0.8 

-0.26 

7 

5 

50793 

3 

0 

6 

12 

-0.38 

0.41 

0.91 

-0.22 

7 

5 

50793 

4 

0 

1 

2 

-1.16 

0 

0.27 

-0.17 

7 

6 

50195 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.05 

7 

6 

50195 

1 

1 

33 

63 

0.69 

0.22 

1.29 

0.46 

7 

6 

50195 

2 

0 

9 

17 

-0.08 

0.26 

1.05 

-0.12 

7 

6 

50195 

3 

0 

5 

10 

-0.5 

0.48 

0.84 

-0.19 

7 

6 

50195 

4 

0 

5 

10 

-1.3 

0.36 

0.3 

-0.4 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

7 

50315 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.04 

7 

7 

50315 

1 

1 

33 

63 

0.87 

0.16 

0.83 

0.55 

7 

7 

50315 

2 

0 

13 

25 

-0.24 

0.21 

0.73 

-0.38 

7 

7 

50315 

3 

0 

3 

6 

-0.17 

0.36 

0.69 

-0.15 

7 

7 

50315 

4 

0 

3 

6 

-0.71 

0.59 

0.52 

-0.28 

7 

8 

50176 

* 

-1 

4707 

99 

0.91 

0.02 

0 

0.05 

7 

8 

50176 

1 

1 

30 

56 

0.62 

0.16 

1.02 

0.43 

7 

8 

50176 

2 

0 

10 

19 

-0.64 

0.33 

0.65 

-0.39 

7 

8 

50176 

3 

0 

6 

11 

0.07 

0.52 

1.56 

-0.05 

7 

8 

50176 

4 

0 

8 

15 

-0.11 

0.28 

0.94 

-0.13 

7 

9 

50925 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

7 

9 

50925 

1 

1 

27 

55 

0.96 

0.24 

1.14 

0.45 

7 

9 

50925 

2 

0 

10 

20 

0.14 

0.23 

1.01 

-0.14 

7 

9 

50925 

3 

0 

4 

8 

-0.26 

0.27 

0.58 

-0.19 

7 

9 

50925 

4 

0 

8 

16 

-0.37 

0.36 

0.72 

-0.32 

7 

10 

5NBT212 

* 

-1 

4658 

98 

0.88 

0.02 

0 

-0.1 

7 

10 

5NBT212 

1 

1 

79 

77 

2.02 

0.1 

1.01 

0.34 

7 

10 

5NBT212 

2 

0 

17 

17 

1.24 

0.16 

0.84 

-0.3 

7 

10 

5NBT212 

3 

0 

7 

7 

1.38 

0.41 

1.34 

-0.14 

7 

10 

5NBT212 

4 

0 

0 

0 

0 

0 

0 

0 

7 

11 

50789 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.05 

7 

11 

50789 

1 

1 

16 

33 

0.67 

0.27 

1.46 

0.25 

7 

11 

50789 

2 

0 

10 

20 

0.7 

0.31 

1.98 

0.2 

7 

11 

50789 

3 

0 

7 

14 

-0.03 

0.34 

0.91 

-0.12 

7 

11 

50789 

4 

0 

16 

33 

-0.23 

0.24 

0.67 

-0.34 

7 

12 

50230 

* 

-1 

4711 

99 

0.9 

0.02 

0 

0.02 

7 

12 

50230 

1 

1 

41 

82 

0.79 

0.18 

1.05 

0.24 

7 

12 

50230 

2 

0 

5 

10 

0.04 

0.64 

1.74 

-0.18 

7 

12 

50230 

3 

0 

2 

4 

0.25 

0.16 

1 

-0.07 

7 

12 

50230 

4 

0 

2 

4 

-0.07 

0.46 

0.79 

-0.13 



easyCBM CCSS Fifth Grade Math Measure Development 


121 

Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

13 

50513 

* 

-1 

4708 

99 

0.91 

0.02 

0 

0.03 

7 

13 

50513 

1 

1 

36 

68 

0.96 

0.19 

0.81 

0.56 

7 

13 

50513 

2 

0 

2 

4 

-1.09 

0.01 

0.26 

-0.26 

7 

13 

50513 

3 

0 

15 

28 

-0.41 

0.21 

0.71 

-0.47 

7 

13 

50513 

4 

0 

0 

0 

0 

0 

0 

0 

7 

14 

50678 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.03 

7 

14 

50678 

1 

1 

25 

52 

1.03 

0.23 

0.97 

0.43 

7 

14 

50678 

2 

0 

14 

29 

0.05 

0.2 

0.82 

-0.28 

7 

14 

50678 

3 

0 

7 

15 

0.44 

0.42 

1.65 

-0.04 

7 

14 

50678 

4 

0 

2 

4 

-1.35 

0.99 

0.25 

-0.34 

7 

15 

5NF67 

* 

-1 

4668 

98 

0.89 

0.02 

0 

-0.06 

7 

15 

5NF67 

1 

1 

53 

57 

1.8 

0.15 

0.97 

0.39 

7 

15 

5NF67 

2 

0 

22 

24 

1.13 

0.17 

1.09 

-0.17 

7 

15 

5NF67 

3 

0 

18 

19 

0.82 

0.15 

0.74 

-0.3 

7 

15 

5NF67 

4 

0 

0 

0 

0 

0 

0 

0 

7 

16 

5NF53 

* 

-1 

4664 

98 

0.87 

0.02 

0 

-0.16 

7 

16 

5NF53 

1 

1 

63 

65 

2.73 

0.14 

1.05 

0.34 

7 

16 

5NF53 

2 

0 

20 

21 

2.18 

0.22 

1.52 

-0.11 

7 

16 

5NF53 

3 

0 

14 

14 

1.49 

0.28 

0.78 

-0.34 

7 

16 

5NF53 

4 

0 

0 

0 

0 

0 

0 

0 

7 

17 

50259 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.05 

7 

17 

50259 

1 

1 

44 

85 

0.36 

0.16 

1.01 

0.27 

7 

17 

50259 

2 

0 

5 

10 

-0.59 

0.38 

0.88 

-0.25 

7 

17 

50259 

3 

0 

3 

6 

-0.23 

0.76 

1.39 

-0.11 

7 

17 

50259 

4 

0 

0 

0 

0 

0 

0 

0 

7 

18 

50424 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

7 

18 

50424 

1 

1 

39 

78 

0.78 

0.22 

1.14 

0.38 

7 

18 

50424 

2 

0 

2 

4 

-0.83 

0.16 

0.42 

-0.2 

7 

18 

50424 

3 

0 

1 

2 

-0.9 

0 

0.38 

-0.15 

7 

18 

50424 

4 

0 

8 

16 

-0.34 

0.43 

1.13 

-0.27 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

19 

50893 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.05 

7 

19 

50893 

1 

1 

27 

55 

0.85 

0.25 

0.83 

0.5 

7 

19 

50893 

2 

0 

10 

20 

-0.67 

0.38 

0.99 

-0.37 

7 

19 

50893 

3 

0 

3 

6 

-0.39 

0.14 

0.62 

-0.13 

7 

19 

50893 

4 

0 

9 

18 

-0.18 

0.21 

0.89 

-0.17 

7 

20 

51013 

* 

-1 

4707 

99 

0.9 

0.02 

0 

0.01 

7 

20 

51013 

1 

1 

33 

61 

1.3 

0.19 

1.02 

0.45 

7 

20 

51013 

2 

0 

9 

17 

0.59 

0.32 

1.18 

-0.07 

7 

20 

51013 

3 

0 

9 

17 

0.1 

0.18 

0.58 

-0.23 

7 

20 

51013 

4 

0 

3 

6 

-1.91 

1.82 

0.42 

-0.48 

7 

21 

51178 

* 

-1 

4713 

99 

0.9 

0.02 

0 

0.01 

7 

21 

51178 

1 

1 

23 

48 

1.76 

0.31 

0.7 

0.61 

7 

21 

51178 

2 

0 

7 

15 

-0.34 

0.29 

0.45 

-0.33 

7 

21 

51178 

3 

0 

6 

13 

0.22 

0.43 

0.91 

-0.15 

7 

21 

51178 

4 

0 

12 

25 

0.01 

0.24 

0.74 

-0.32 

7 

22 

51193 

* 

-1 

4705 

99 

0.91 

0.02 

0 

0.04 

7 

22 

51193 

1 

1 

17 

30 

1.06 

0.28 

1.24 

0.37 

7 

22 

51193 

2 

0 

7 

13 

0.49 

0.49 

1.96 

0.02 

7 

22 

51193 

3 

0 

24 

43 

0.14 

0.19 

0.96 

-0.22 

7 

22 

51193 

4 

0 

8 

14 

-0.08 

0.37 

0.81 

-0.19 

7 

23 

5G222 

* 

-1 

4663 

98 

0.89 

0.02 

0 

-0.09 

7 

23 

5G222 

1 

1 

82 

84 

1.8 

0.1 

1.02 

0.22 

7 

23 

5G222 

2 

0 

3 

3 

1.35 

0.52 

1.1 

-0.07 

7 

23 

5G222 

3 

0 

13 

13 

1.26 

0.22 

1.12 

-0.2 

7 

23 

5G222 

4 

0 

0 

0 

0 

0 

0 

0 

7 

24 

5G322 

* 

-1 

4636 

97 

0.89 

0.02 

0 

-0.07 

7 

24 

5G322 

1 

1 

84 

67 

1.81 

0.13 

0.89 

0.44 

7 

24 

5G322 

2 

0 

14 

11 

0.75 

0.17 

0.75 

-0.21 

7 

24 

5G322 

3 

0 

27 

22 

0.68 

0.18 

0.92 

-0.34 

7 

24 

5G322 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

25 

5G221 

* 

-1 

4639 

97 

0.88 

0.02 

0 

-0.12 

7 

25 

5G221 

1 

1 

83 

68 

2.09 

0.09 

0.99 

0.37 

7 

25 

5G221 

2 

0 

6 

5 

1.9 

0.42 

1.82 

0.01 

7 

25 

5G221 

3 

0 

33 

27 

1.3 

0.12 

0.82 

-0.39 

7 

25 

5G221 

4 

0 

0 

0 

0 

0 

0 

0 

7 

26 

50617 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.05 

7 

26 

50617 

1 

1 

39 

75 

0.72 

0.19 

0.77 

0.61 

7 

26 

50617 

2 

0 

4 

8 

-0.85 

0.54 

0.71 

-0.22 

7 

26 

50617 

3 

0 

3 

6 

-1.61 

0.51 

0.31 

-0.33 

7 

26 

50617 

4 

0 

6 

12 

-1.31 

0.25 

0.39 

-0.4 

7 

27 

50219 

* 

-1 

4701 

99 

0.91 

0.02 

0 

0.02 

7 

27 

50219 

1 

1 

40 

67 

1.11 

0.22 

0.97 

0.48 

7 

27 

50219 

2 

0 

12 

20 

-0.15 

0.32 

1.06 

-0.26 

7 

27 

50219 

3 

0 

6 

10 

-0.56 

0.3 

0.55 

-0.26 

7 

27 

50219 

4 

0 

2 

3 

-1.33 

2 

0.78 

-0.24 

7 

28 

51000 

* 

-1 

4698 

99 

0.9 

0.02 

0 

-0.01 

7 

28 

51000 

1 

1 

45 

71 

1.57 

0.2 

0.9 

0.5 

7 

28 

51000 

2 

0 

9 

14 

0.46 

0.27 

0.93 

-0.15 

7 

28 

51000 

3 

0 

5 

8 

-0.5 

0.37 

0.35 

-0.29 

7 

28 

51000 

4 

0 

4 

6 

-1.28 

1.57 

0.93 

-0.38 

7 

29 

51010 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.03 

7 

29 

51010 

1 

1 

26 

50 

1.04 

0.22 

1.03 

0.36 

7 

29 

51010 

2 

0 

10 

19 

0.93 

0.3 

2.09 

0.13 

7 

29 

51010 

3 

0 

13 

25 

-0.08 

0.26 

0.75 

-0.29 

7 

29 

51010 

4 

0 

3 

6 

-1.81 

1.1 

0.19 

-0.46 

7 

30 

5MD415 

* 

-1 

4666 

98 

0.91 

0.02 

0 

0.02 

7 

30 

5MD415 

1 

1 

42 

44 

1.14 

0.12 

0.87 

0.44 

7 

30 

5MD415 

2 

0 

9 

9 

0.28 

0.2 

0.73 

-0.2 

7 

30 

5MD415 

3 

0 

44 

46 

0.48 

0.1 

0.92 

-0.33 

7 

30 

5MD415 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

1 

50A319 

* 

-1 

4643 

98 

0.89 

0.02 

0 

-0.08 

8 

1 

50A319 

1 

1 

85 

72 

1.8 

0.11 

0.93 

0.4 

8 

1 

50A319 

2 

0 

22 

19 

0.86 

0.13 

0.74 

-0.32 

8 

1 

50A319 

3 

0 

11 

9 

0.98 

0.12 

0.75 

-0.18 

8 

1 

50A319 

4 

0 

0 

0 

0 

0 

0 

0 

8 

2 

50A28 

* 

-1 

4661 

98 

0.89 

0.02 

0 

-0.06 

8 

2 

50A28 

1 

1 

56 

56 

1.76 

0.13 

1.04 

0.37 

8 

2 

50A28 

2 

0 

24 

24 

1.17 

0.12 

0.97 

-0.18 

8 

2 

50A28 

3 

0 

20 

20 

0.99 

0.14 

0.81 

-0.27 

8 

2 

50A28 

4 

0 

0 

0 

0 

0 

0 

0 

8 

3 

50A126 

* 

-1 

4660 

98 

0.88 

0.02 

0 

-0.1 

8 

3 

50A126 

1 

1 

52 

51 

2.19 

0.17 

1.08 

0.38 

8 

3 

50A126 

2 

0 

28 

28 

1.45 

0.21 

1.84 

-0.17 

8 

3 

50A126 

3 

0 

21 

21 

1.16 

0.15 

0.72 

-0.27 

8 

3 

50A126 

4 

0 

0 

0 

0 

0 

0 

0 

8 

4 

50A213 

* 

-1 

4662 

98 

0.88 

0.02 

0 

-0.09 

8 

4 

50A213 

1 

1 

46 

46 

1.88 

0.13 

1.33 

0.14 

8 

4 

50A213 

2 

0 

31 

31 

1.88 

0.16 

1.59 

0.1 

8 

4 

50A213 

3 

0 

22 

22 

1.23 

0.21 

0.92 

-0.28 

8 

4 

50A213 

4 

0 

0 

0 

0 

0 

0 

0 

8 

5 

50772 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.06 

8 

5 

50772 

1 

1 

32 

65 

0.49 

0.2 

1.02 

0.42 

8 

5 

50772 

2 

0 

2 

4 

-1.39 

0.94 

0.4 

-0.26 

8 

5 

50772 

3 

0 

12 

24 

-0.35 

0.29 

1.18 

-0.22 

8 

5 

50772 

4 

0 

3 

6 

-0.91 

0.47 

0.54 

-0.22 

8 

6 

50014 

* 

-1 

4703 

99 

0.91 

0.02 

0 

0.03 

8 

6 

50014 

1 

1 

39 

67 

1 

0.23 

0.91 

0.46 

8 

6 

50014 

2 

0 

10 

17 

-0.55 

0.35 

0.9 

-0.34 

8 

6 

50014 

3 

0 

6 

10 

-0.07 

0.4 

1.15 

-0.14 

8 

6 

50014 

4 

0 

3 

5 

-0.74 

0.72 

0.69 

-0.2 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

7 

50033 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.04 

8 

7 

50033 

1 

1 

31 

62 

1.16 

0.21 

0.64 

0.68 

8 

7 

50033 

2 

0 

12 

24 

-0.59 

0.28 

0.75 

-0.39 

8 

7 

50033 

3 

0 

4 

8 

-1.37 

0.55 

0.32 

-0.36 

8 

7 

50033 

4 

0 

3 

6 

-1.12 

0.2 

0.29 

-0.27 

8 

8 

5NBT52 

* 

-1 

4666 

98 

0.91 

0.02 

0 

0.02 

8 

8 

5NBT52 

1 

1 

63 

66 

1.01 

0.1 

0.9 

0.46 

8 

8 

5NBT52 

2 

0 

16 

17 

0.03 

0.13 

0.63 

-0.42 

8 

8 

5NBT52 

3 

0 

16 

17 

0.46 

0.12 

0.93 

-0.17 

8 

8 

5NBT52 

4 

0 

0 

0 

0 

0 

0 

0 

8 

9 

5NBT320 

* 

-1 

4657 

98 

0.88 

0.02 

0 

-0.1 

8 

9 

5NBT320 

1 

1 

81 

78 

2.03 

0.12 

0.9 

0.43 

8 

9 

5NBT320 

2 

0 

8 

8 

0.92 

0.2 

0.66 

-0.21 

8 

9 

5NBT320 

3 

0 

15 

14 

0.8 

0.22 

0.78 

-0.35 

8 

9 

5NBT320 

4 

0 

0 

0 

0 

0 

0 

0 

8 

10 

50046 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

8 

10 

50046 

1 

1 

25 

50 

1.28 

0.29 

0.86 

0.52 

8 

10 

50046 

2 

0 

13 

26 

-0.11 

0.28 

1.09 

-0.26 

8 

10 

50046 

3 

0 

0 

0 

0 

0 

0 

0 

8 

10 

50046 

4 

0 

12 

24 

-0.38 

0.31 

0.84 

-0.35 

8 

11 

5NBT34 

* 

-1 

4666 

98 

0.91 

0.02 

0 

0.02 

8 

11 

5NBT34 

1 

1 

39 

41 

1.06 

0.14 

1.03 

0.33 

8 

11 

5NBT34 

2 

0 

39 

41 

0.68 

0.09 

1.07 

-0.08 

8 

11 

5NBT34 

3 

0 

17 

18 

0.22 

0.15 

0.7 

-0.32 

8 

11 

5NBT34 

4 

0 

0 

0 

0 

0 

0 

0 

8 

12 

50228 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

8 

12 

50228 

1 

1 

40 

80 

0.68 

0.13 

0.89 

0.45 

8 

12 

50228 

2 

0 

0 

0 

0 

0 

0 

0 

8 

12 

50228 

3 

0 

8 

16 

-0.26 

0.34 

0.89 

-0.33 

8 

12 

50228 

4 

0 

2 

4 

-0.96 

0.79 

0.4 

-0.3 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

13 

50353 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.03 

8 

13 

50353 

1 

1 

34 

67 

0.95 

0.27 

1.18 

0.43 

8 

13 

50353 

2 

0 

7 

14 

-0.76 

0.14 

0.46 

-0.34 

8 

13 

50353 

3 

0 

9 

18 

-0.12 

0.3 

1.3 

-0.2 

8 

13 

50353 

4 

0 

1 

2 

-0.04 

0 

0.89 

-0.05 

8 

14 

50378 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.03 

8 

14 

50378 

1 

1 

26 

50 

1.07 

0.17 

0.8 

0.55 

8 

14 

50378 

2 

0 

20 

38 

0.08 

0.18 

0.9 

-0.32 

8 

14 

50378 

3 

0 

2 

4 

-1.91 

0.22 

0.09 

-0.46 

8 

14 

50378 

4 

0 

4 

8 

0.11 

0.16 

0.7 

-0.11 

8 

15 

50997 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

8 

15 

50997 

1 

1 

19 

39 

1.08 

0.28 

1.03 

0.42 

8 

15 

50997 

2 

0 

5 

10 

-0.4 

0.42 

0.53 

-0.28 

8 

15 

50997 

3 

0 

21 

43 

0.27 

0.18 

0.99 

-0.19 

8 

15 

50997 

4 

0 

4 

8 

0.2 

0.33 

0.81 

-0.08 

8 

16 

5NF411 

* 

-1 

4649 

98 

0.89 

0.02 

0 

-0.04 

8 

16 

5NF411 

1 

1 

47 

42 

1.65 

0.16 

1.05 

0.35 

8 

16 

5NF411 

2 

0 

51 

46 

0.93 

0.12 

1.05 

-0.27 

8 

16 

5NF411 

3 

0 

14 

13 

0.9 

0.29 

1.2 

-0.12 

8 

16 

5NF411 

4 

0 

0 

0 

0 

0 

0 

0 

8 

17 

50252 

* 

-1 

4704 

99 

0.91 

0.02 

0 

0.04 

8 

17 

50252 

1 

1 

49 

86 

0.72 

0.16 

0.81 

0.52 

8 

17 

50252 

2 

0 

7 

12 

-1.09 

0.41 

0.58 

-0.45 

8 

17 

50252 

3 

0 

1 

2 

-2.03 

0 

0.14 

-0.26 

8 

17 

50252 

4 

0 

0 

0 

0 

0 

0 

0 

8 

18 

50466 

* 

-1 

4703 

99 

0.91 

0.02 

0 

0.03 

8 

18 

50466 

1 

1 

45 

78 

0.85 

0.15 

0.84 

0.52 

8 

18 

50466 

2 

0 

4 

7 

-0.63 

0.63 

0.81 

-0.28 

8 

18 

50466 

3 

0 

3 

5 

-0.61 

0.23 

0.46 

-0.23 

8 

18 

50466 

4 

0 

6 

10 

-0.51 

0.3 

0.61 

-0.31 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

19 

50416 

* 

-1 

4464 

94 

0.87 

0.02 

0 

-0.08 

8 

19 

50416 

1 

1 

222 

75 

1.58 

0.08 

0.96 

0.38 

8 

19 

50416 

2 

0 

64 

22 

0.68 

0.11 

0.98 

-0.28 

8 

19 

50416 

3 

0 

4 

1 

0.99 

0.17 

0.99 

-0.03 

8 

19 

50416 

4 

0 

7 

2 

-1.05 

0.47 

0.22 

-0.3 

8 

20 

50890 

* 

-1 

4712 

99 

0.9 

0.02 

0 

0.01 

8 

20 

50890 

1 

1 

28 

57 

1.65 

0.29 

0.73 

0.62 

8 

20 

50890 

2 

0 

8 

16 

-0.17 

0.39 

0.87 

-0.25 

8 

20 

50890 

3 

0 

7 

14 

-1.1 

0.21 

0.25 

-0.46 

8 

20 

50890 

4 

0 

6 

12 

0.09 

0.36 

0.9 

-0.15 

8 

21 

51167 

* 

-1 

4713 

99 

0.9 

0.02 

0 

0.01 

8 

21 

51167 

1 

1 

24 

50 

1.5 

0.3 

1.1 

0.49 

8 

21 

51167 

2 

0 

5 

10 

0.44 

0.41 

1.15 

-0.08 

8 

21 

51167 

3 

0 

8 

17 

0.11 

0.39 

0.93 

-0.21 

8 

21 

51167 

4 

0 

11 

23 

-0.12 

0.34 

0.72 

-0.34 

8 

22 

51195 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.04 

8 

22 

51195 

1 

1 

15 

31 

0.99 

0.38 

1.58 

0.32 

8 

22 

51195 

2 

0 

5 

10 

-0.19 

0.21 

0.5 

-0.16 

8 

22 

51195 

3 

0 

21 

44 

0.36 

0.26 

1.6 

-0.03 

8 

22 

51195 

4 

0 

7 

15 

-0.37 

0.33 

0.52 

-0.25 

8 

23 

5G34 

* 

-1 

4636 

97 

0.89 

0.02 

0 

-0.04 

8 

23 

5G34 

1 

1 

95 

76 

1.39 

0.1 

1.01 

0.28 

8 

23 

5G34 

2 

0 

23 

18 

0.73 

0.19 

1.19 

-0.23 

8 

23 

5G34 

3 

0 

7 

6 

0.69 

0.27 

0.97 

-0.13 

8 

23 

5G34 

4 

0 

0 

0 

0 

0 

0 

0 

8 

24 

5G316 

* 

-1 

4651 

98 

0.88 

0.02 

0 

-0.09 

8 

24 

5G316 

1 

1 

81 

74 

2.01 

0.09 

0.87 

0.51 

8 

24 

5G316 

2 

0 

6 

5 

0.47 

0.28 

0.41 

-0.32 

8 

24 

5G316 

3 

0 

23 

21 

1.04 

0.17 

0.88 

-0.37 

8 

24 

5G316 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

25 

5G33 

* 

-1 

4651 

98 

0.88 

0.02 

0 

-0.09 

8 

25 

5G33 

1 

1 

69 

63 

2.19 

0.13 

0.84 

0.52 

8 

25 

5G33 

2 

0 

24 

22 

1.24 

0.16 

1.05 

-0.21 

8 

25 

5G33 

3 

0 

17 

15 

0.44 

0.18 

0.46 

-0.45 

8 

25 

5G33 

4 

0 

0 

0 

0 

0 

0 

0 

8 

26 

50017 

* 

-1 

4706 

99 

0.9 

0.02 

0 

0.01 

8 

26 

50017 

1 

1 

45 

82 

1.12 

0.2 

0.85 

0.5 

8 

26 

50017 

2 

0 

2 

4 

0.24 

1.15 

1.75 

-0.07 

8 

26 

50017 

3 

0 

6 

11 

-1.06 

0.29 

0.33 

-0.45 

8 

26 

50017 

4 

0 

2 

4 

-0.6 

0.39 

0.47 

-0.19 

8 

27 

50828 

* 

-1 

4714 

99 

0.91 

0.02 

0 

0.04 

8 

27 

50828 

1 

1 

30 

64 

0.96 

0.22 

0.74 

0.51 

8 

27 

50828 

2 

0 

4 

9 

-0.61 

0.56 

0.68 

-0.23 

8 

27 

50828 

3 

0 

7 

15 

0.02 

0.56 

1.92 

-0.12 

8 

27 

50828 

4 

0 

6 

13 

-1.05 

0.28 

0.36 

-0.42 

8 

28 

50998 

* 

-1 

4710 

99 

0.9 

0.02 

0 

0.02 

8 

28 

50998 

1 

1 

33 

65 

1.33 

0.24 

0.91 

0.52 

8 

28 

50998 

2 

0 

2 

4 

0.35 

0.53 

0.98 

-0.04 

8 

28 

50998 

3 

0 

5 

10 

-0.54 

0.32 

0.43 

-0.25 

8 

28 

50998 

4 

0 

11 

22 

-0.57 

0.58 

0.91 

-0.4 

8 

29 

50413 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

8 

29 

50413 

1 

1 

23 

46 

1.05 

0.31 

1.22 

0.42 

8 

29 

50413 

2 

0 

11 

22 

0.2 

0.28 

1.19 

-0.11 

8 

29 

50413 

3 

0 

11 

22 

-0.26 

0.22 

0.61 

-0.31 

8 

29 

50413 

4 

0 

5 

10 

0.03 

0.47 

0.99 

-0.12 

8 

30 

5MD29 

* 

-1 

4637 

97 

0.88 

0.02 

0 

-0.08 

8 

30 

5MD29 

1 

1 

75 

60 

1.96 

0.12 

0.87 

0.44 

8 

30 

5MD29 

2 

0 

28 

23 

0.92 

0.12 

0.71 

-0.35 

8 

30 

5MD29 

3 

0 

21 

17 

1.18 

0.15 

0.98 

-0.18 

8 

30 

5MD29 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

1 

50A216 

* 

-1 

4662 

98 

0.89 

0.02 

0 

-0.05 

9 

1 

50A216 

1 

1 

67 

68 

1.64 

0.14 

1 

0.38 

9 

1 

50A216 

2 

0 

16 

16 

0.76 

0.17 

0.81 

-0.25 

9 

1 

50A216 

3 

0 

16 

16 

0.8 

0.17 

0.9 

-0.23 

9 

1 

50A216 

4 

0 

0 

0 

0 

0 

0 

0 

9 

2 

50A228 

* 

-1 

4650 

98 

0.88 

0.02 

0 

-0.11 

9 

2 

50A228 

1 

1 

74 

67 

2.1 

0.09 

0.93 

0.36 

9 

2 

50A228 

2 

0 

11 

10 

1.02 

0.19 

0.57 

-0.34 

9 

2 

50A228 

3 

0 

26 

23 

1.64 

0.16 

1.22 

-0.16 

9 

2 

50A228 

4 

0 

0 

0 

0 

0 

0 

0 

9 

3 

50A117 

* 

-1 

4668 

98 

0.89 

0.02 

0 

-0.08 

9 

3 

50A117 

1 

1 

51 

55 

2.03 

0.13 

1.01 

0.4 

9 

3 

50A117 

2 

0 

10 

11 

0.73 

0.19 

0.47 

-0.38 

9 

3 

50A117 

3 

0 

32 

34 

1.5 

0.11 

1.04 

-0.17 

9 

3 

50A117 

4 

0 

0 

0 

0 

0 

0 

0 

9 

4 

50A232 

* 

-1 

4662 

98 

0.89 

0.02 

0 

-0.05 

9 

4 

50A232 

1 

1 

38 

38 

1.73 

0.19 

1.21 

0.27 

9 

4 

50A232 

2 

0 

22 

22 

0.96 

0.21 

1.1 

-0.2 

9 

4 

50A232 

3 

0 

39 

39 

1.24 

0.15 

1.31 

-0.1 

9 

4 

50A232 

4 

0 

0 

0 

0 

0 

0 

0 

9 

5 

50625 

* 

-1 

4708 

99 

0.91 

0.02 

0 

0.04 

9 

5 

50625 

1 

1 

37 

70 

1 

0.21 

0.92 

0.6 

9 

5 

50625 

2 

0 

2 

4 

-0.8 

0.46 

0.47 

-0.16 

9 

5 

50625 

3 

0 

4 

8 

-0.97 

0.26 

0.39 

-0.27 

9 

5 

50625 

4 

0 

10 

19 

-0.93 

0.37 

0.71 

-0.44 

9 

6 

50785 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.05 

9 

6 

50785 

1 

1 

31 

63 

0.82 

0.17 

0.7 

0.66 

9 

6 

50785 

2 

0 

4 

8 

-1.04 

0.49 

0.44 

-0.32 

9 

6 

50785 

3 

0 

5 

10 

-0.99 

0.4 

0.43 

-0.35 

9 

6 

50785 

4 

0 

9 

18 

-0.58 

0.23 

0.63 

-0.32 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

7 

50913 

* 

-1 

4712 

99 

0.9 

0.02 

0 

0.01 

9 

7 

50913 

1 

1 

33 

67 

1.22 

0.24 

0.9 

0.46 

9 

7 

50913 

2 

0 

3 

6 

-0.97 

0.59 

0.33 

-0.29 

9 

7 

50913 

3 

0 

5 

10 

0.18 

0.31 

0.98 

-0.12 

9 

7 

50913 

4 

0 

8 

16 

-0.28 

0.59 

1.17 

-0.3 

9 

8 

50902 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

9 

8 

50902 

1 

1 

29 

59 

0.82 

0.24 

1.15 

0.33 

9 

8 

50902 

2 

0 

8 

16 

0.39 

0.33 

1.42 

-0.05 

9 

8 

50902 

3 

0 

6 

12 

0.13 

0.28 

0.98 

-0.12 

9 

8 

50902 

4 

0 

6 

12 

-0.48 

0.26 

0.54 

-0.32 

9 

9 

5NBT513 

* 

-1 

4643 

98 

0.89 

0.02 

0 

-0.07 

9 

9 

5NBT513 

1 

1 

86 

73 

1.75 

0.12 

0.95 

0.42 

9 

9 

5NBT513 

2 

0 

11 

9 

0.91 

0.21 

0.94 

-0.16 

9 

9 

5NBT513 

3 

0 

21 

18 

0.58 

0.11 

0.62 

-0.37 

9 

9 

5NBT513 

4 

0 

0 

0 

0 

0 

0 

0 

9 

10 

50921 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.04 

9 

10 

50921 

1 

1 

24 

49 

0.61 

0.19 

1.28 

0.24 

9 

10 

50921 

2 

0 

12 

24 

0.12 

0.2 

0.9 

-0.2 

9 

10 

50921 

3 

0 

13 

27 

0.29 

0.2 

1.13 

-0.09 

9 

10 

50921 

4 

0 

0 

0 

0 

0 

0 

0 

9 

11 

5NBT516 

* 

-1 

4658 

98 

0.89 

0.02 

0 

-0.06 

9 

11 

5NBT516 

1 

1 

58 

56 

1.85 

0.11 

0.84 

0.5 

9 

11 

5NBT516 

2 

0 

15 

15 

0.99 

0.12 

0.74 

-0.22 

9 

11 

5NBT516 

3 

0 

30 

29 

0.95 

0.14 

0.85 

-0.37 

9 

11 

5NBT516 

4 

0 

0 

0 

0 

0 

0 

0 

9 

12 

50241 

* 

-1 

4711 

99 

0.9 

0.02 

0 

0 

9 

12 

50241 

1 

1 

41 

82 

1.21 

0.22 

0.88 

0.48 

9 

12 

50241 

2 

0 

5 

10 

-0.45 

0.36 

0.69 

-0.3 

9 

12 

50241 

3 

0 

2 

4 

-1.12 

0.75 

0.33 

-0.27 

9 

12 

50241 

4 

0 

2 

4 

-0.72 

0.08 

0.38 

-0.22 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

13 

50493 

* 

-1 

4715 

99 

0.91 

0.02 

0 

0.03 

9 

13 

50493 

1 

1 

32 

70 

0.91 

0.19 

0.97 

0.48 

9 

13 

50493 

2 

0 

8 

17 

-0.31 

0.35 

0.82 

-0.34 

9 

13 

50493 

3 

0 

3 

7 

0.14 

0.33 

0.95 

-0.09 

9 

13 

50493 

4 

0 

3 

7 

-0.7 

0.5 

0.44 

-0.29 

9 

14 

50653 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.05 

9 

14 

50653 

1 

1 

24 

47 

0.75 

0.25 

1.22 

0.31 

9 

14 

50653 

2 

0 

11 

22 

0.44 

0.35 

1.81 

0.05 

9 

14 

50653 

3 

0 

5 

10 

-1.15 

0.8 

0.68 

-0.37 

9 

14 

50653 

4 

0 

11 

22 

-0.07 

0.29 

0.91 

-0.15 

9 

15 

50684 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

9 

15 

50684 

1 

1 

19 

38 

1.17 

0.28 

1.13 

0.46 

9 

15 

50684 

2 

0 

13 

26 

0.36 

0.25 

1.14 

-0.05 

9 

15 

50684 

3 

0 

6 

12 

-0.56 

0.52 

0.5 

-0.31 

9 

15 

50684 

4 

0 

12 

24 

-0.04 

0.25 

0.69 

-0.24 

9 

16 

5NF316 

* 

-1 

4662 

98 

0.88 

0.02 

0 

-0.11 

9 

16 

5NF316 

1 

1 

57 

58 

2.48 

0.15 

0.89 

0.55 

9 

16 

5NF316 

2 

0 

24 

24 

1.3 

0.13 

0.79 

-0.33 

9 

16 

5NF316 

3 

0 

18 

18 

1.15 

0.17 

0.69 

-0.34 

9 

16 

5NF316 

4 

0 

0 

0 

0 

0 

0 

0 

9 

17 

50599 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.07 

9 

17 

50599 

1 

1 

40 

82 

0.41 

0.15 

0.62 

0.66 

9 

17 

50599 

2 

0 

2 

4 

-1.57 

0.3 

0.33 

-0.25 

9 

17 

50599 

3 

0 

2 

4 

-2.09 

0.37 

0.2 

-0.33 

9 

17 

50599 

4 

0 

5 

10 

-1.78 

0.71 

0.7 

-0.46 

9 

18 

50879 

* 

-1 

4712 

99 

0.9 

0.02 

0 

0.02 

9 

18 

50879 

1 

1 

39 

80 

1.03 

0.19 

0.81 

0.51 

9 

18 

50879 

2 

0 

4 

8 

-0.96 

0.27 

0.33 

-0.38 

9 

18 

50879 

3 

0 

3 

6 

-0.15 

0.5 

0.86 

-0.17 

9 

18 

50879 

4 

0 

3 

6 

-0.62 

0.25 

0.44 

-0.26 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

19 

51168 

* 

-1 

4479 

94 

0.86 

0.02 

0 

-0.14 

9 

19 

51168 

1 

1 

225 

80 

1.89 

0.06 

0.88 

0.51 

9 

19 

51168 

2 

0 

32 

11 

0.83 

0.13 

0.77 

-0.27 

9 

19 

51168 

3 

0 

13 

5 

0.49 

0.22 

0.56 

-0.24 

9 

19 

51168 

4 

0 

12 

4 

-0.03 

0.2 

0.31 

-0.34 

9 

20 

50587 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.04 

9 

20 

50587 

1 

1 

26 

52 

1.1 

0.19 

0.83 

0.61 

9 

20 

50587 

2 

0 

6 

12 

-0.43 

0.35 

0.6 

-0.22 

9 

20 

50587 

3 

0 

6 

12 

-0.78 

0.45 

0.48 

-0.32 

9 

20 

50587 

4 

0 

12 

24 

-0.34 

0.36 

0.8 

-0.3 

9 

21 

5MD41 

* 

-1 

4640 

97 

0.89 

0.02 

0 

-0.07 

9 

21 

5MD41 

1 

1 

73 

60 

1.87 

0.14 

0.93 

0.46 

9 

21 

5MD41 

2 

0 

30 

25 

0.91 

0.11 

0.85 

-0.27 

9 

21 

5MD41 

3 

0 

18 

15 

0.66 

0.17 

0.72 

-0.29 

9 

21 

5MD41 

4 

0 

0 

0 

0 

0 

0 

0 

9 

22 

5MD121 

* 

-1 

4639 

97 

0.89 

0.02 

0 

-0.07 

9 

22 

5MD121 

1 

1 

58 

48 

1.9 

0.17 

1.09 

0.36 

9 

22 

5MD121 

2 

0 

48 

39 

1.12 

0.12 

1.1 

-0.25 

9 

22 

5MD121 

3 

0 

16 

13 

0.95 

0.17 

0.8 

-0.18 

9 

22 

5MD121 

4 

0 

0 

0 

0 

0 

0 

0 

9 

23 

5G417 

* 

-1 

4513 

95 

0.87 

0.02 

0 

-0.11 

9 

23 

5G417 

1 

1 

197 

79 

1.71 

0.08 

0.95 

0.32 

9 

23 

5G417 

2 

0 

29 

12 

1.02 

0.18 

1.55 

-0.17 

9 

23 

5G417 

3 

0 

22 

9 

0.64 

0.12 

0.63 

-0.26 

9 

23 

5G417 

4 

0 

0 

0 

0 

0 

0 

0 

9 

24 

5G315 

* 

-1 

4536 

95 

0.85 

0.02 

0 

-0.18 

9 

24 

5G315 

1 

1 

171 

76 

2.24 

0.09 

0.92 

0.42 

9 

24 

5G315 

2 

0 

28 

12 

0.92 

0.13 

0.61 

-0.34 

9 

24 

5G315 

3 

0 

26 

12 

1.31 

0.14 

0.94 

-0.2 

9 

24 

5G315 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

25 

5G120 

* 

-1 

4646 

98 

0.88 

0.02 

0 

-0.12 

9 

25 

5G120 

1 

1 

80 

70 

2.21 

0.12 

1.07 

0.41 

9 

25 

5G120 

2 

0 

25 

22 

1.38 

0.15 

0.92 

-0.27 

9 

25 

5G120 

3 

0 

10 

9 

1 

0.27 

0.63 

-0.27 

9 

25 

5G120 

4 

0 

0 

0 

0 

0 

0 

0 

9 

26 

50192 

* 

-1 

4703 

99 

0.9 

0.02 

0 

0.01 

9 

26 

50192 

1 

1 

48 

83 

0.99 

0.19 

0.96 

0.36 

9 

26 

50192 

2 

0 

2 

3 

-0.48 

0.82 

0.63 

-0.18 

9 

26 

50192 

3 

0 

5 

9 

0.35 

0.4 

1.33 

-0.1 

9 

26 

50192 

4 

0 

3 

5 

-1.18 

0.46 

0.29 

-0.35 

9 

27 

50373 

* 

-1 

4709 

99 

0.91 

0.02 

0 

0.04 

9 

27 

50373 

1 

1 

33 

63 

0.87 

0.21 

0.89 

0.48 

9 

27 

50373 

2 

0 

2 

4 

-0.24 

0.11 

0.67 

-0.09 

9 

27 

50373 

3 

0 

12 

23 

-0.34 

0.39 

1.16 

-0.3 

9 

27 

50373 

4 

0 

5 

10 

-0.83 

0.47 

0.53 

-0.3 

9 

28 

50680 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

9 

28 

50680 

1 

1 

30 

61 

1.06 

0.23 

0.87 

0.51 

9 

28 

50680 

2 

0 

14 

29 

-0.08 

0.29 

1.15 

-0.27 

9 

28 

50680 

3 

0 

2 

4 

-0.65 

0.4 

0.42 

-0.18 

9 

28 

50680 

4 

0 

3 

6 

-1.51 

0.36 

0.19 

-0.38 

9 

29 

51029 

* 

-1 

4705 

99 

0.91 

0.02 

0 

0.02 

9 

29 

51029 

1 

1 

28 

50 

1.13 

0.19 

0.94 

0.48 

9 

29 

51029 

2 

0 

20 

36 

0.16 

0.22 

0.94 

-0.34 

9 

29 

51029 

3 

0 

6 

11 

-0.06 

0.22 

0.58 

-0.23 

9 

29 

51029 

4 

0 

2 

4 

0.42 

0.33 

0.86 

-0.04 

9 

30 

5MD518 

* 

-1 

4663 

98 

0.87 

0.02 

0 

-0.17 

9 

30 

5MD518 

1 

1 

73 

74 

2.78 

0.13 

0.95 

0.51 

9 

30 

5MD518 

2 

0 

12 

12 

1.77 

0.2 

0.8 

-0.22 

9 

30 

5MD518 

3 

0 

13 

13 

1.14 

0.11 

0.39 

-0.44 

9 

30 

5MD518 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

1 

50A128 

* 

-1 

4667 

98 

0.91 

0.02 

0 

0.02 

10 

1 

50A128 

1 

1 

53 

56 

1.03 

0.11 

0.93 

0.43 

10 

1 

50A128 

2 

0 

26 

28 

0.47 

0.1 

0.91 

-0.22 

10 

1 

50A128 

3 

0 

15 

16 

0.19 

0.15 

0.74 

-0.31 

10 

1 

50A128 

4 

0 

0 

0 

0 

0 

0 

0 

10 

2 

50 A3 2 

* 

-1 

4645 

98 

0.89 

0.02 

0 

-0.07 

10 

2 

50A32 

1 

1 

66 

57 

1.65 

0.15 

1.19 

0.19 

10 

2 

50 A3 2 

2 

0 

34 

29 

1.46 

0.14 

1.54 

-0.01 

10 

2 

50 A3 2 

3 

0 

16 

14 

0.73 

0.21 

0.84 

-0.26 

10 

2 

50 A3 2 

4 

0 

0 

0 

0 

0 

0 

0 

10 

3 

5OA120 

* 

-1 

4643 

98 

0.89 

0.02 

0 

-0.08 

10 

3 

5OA120 

1 

1 

55 

47 

1.76 

0.17 

1.25 

0.19 

10 

3 

5OA120 

2 

0 

17 

14 

1.46 

0.2 

1.41 

-0.04 

10 

3 

5OA120 

3 

0 

46 

39 

1.34 

0.11 

1.14 

-0.17 

10 

3 

5OA120 

4 

0 

0 

0 

0 

0 

0 

0 

10 

4 

50A233 

* 

-1 

4664 

98 

0.87 

0.02 

0 

-0.16 

10 

4 

50A233 

1 

1 

58 

60 

2.89 

0.15 

1.02 

0.48 

10 

4 

50A233 

2 

0 

28 

29 

1.7 

0.14 

0.72 

-0.41 

10 

4 

50A233 

3 

0 

11 

11 

1.92 

0.31 

1.03 

-0.16 

10 

4 

50A233 

4 

0 

0 

0 

0 

0 

0 

0 

10 

5 

50197 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.03 

10 

5 

50197 

1 

1 

35 

71 

0.81 

0.2 

1 

0.45 

10 

5 

50197 

2 

0 

2 

4 

-1.41 

0.31 

0.21 

-0.32 

10 

5 

50197 

3 

0 

10 

20 

-0.27 

0.25 

0.8 

-0.31 

10 

5 

50197 

4 

0 

2 

4 

-0.11 

0.21 

0.77 

-0.1 

10 

6 

5NBT18 

* 

-1 

4648 

98 

0.89 

0.02 

0 

-0.04 

10 

6 

5NBT18 

1 

1 

91 

81 

1.43 

0.1 

0.92 

0.41 

10 

6 

5NBT18 

2 

0 

13 

12 

0.41 

0.24 

0.83 

-0.29 

10 

6 

5NBT18 

3 

0 

9 

8 

0.35 

0.2 

0.66 

-0.25 

10 

6 

5NBT18 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

7 

50924 

* 

-1 

4495 

94 

0.9 

0.02 

0 

0 

10 

7 

50924 

1 

1 

191 

72 

1.16 

0.07 

0.99 

0.4 

10 

7 

50924 

2 

0 

22 

8 

0.19 

0.2 

0.87 

-0.21 

10 

7 

50924 

3 

0 

49 

18 

0.35 

0.09 

0.85 

-0.26 

10 

7 

50924 

4 

0 

4 

2 

-0.48 

0.52 

0.45 

-0.17 

10 

8 

50003 

* 

-1 

4699 

99 

0.9 

0.02 

0 

0.01 

10 

8 

50003 

1 

1 

40 

65 

1.2 

0.22 

1.48 

0.39 

10 

8 

50003 

2 

0 

6 

10 

-0.42 

0.4 

0.53 

-0.3 

10 

8 

50003 

3 

0 

4 

6 

-0.55 

0.51 

0.47 

-0.26 

10 

8 

50003 

4 

0 

12 

19 

0.59 

0.23 

1.33 

-0.08 

10 

9 

51085 

* 

-1 

4703 

99 

0.9 

0.02 

0 

0.01 

10 

9 

51085 

1 

1 

35 

60 

1.23 

0.18 

1.22 

0.53 

10 

9 

51085 

2 

0 

6 

10 

0.46 

0.19 

0.91 

-0.08 

10 

9 

51085 

3 

0 

8 

14 

-0.01 

0.33 

0.79 

-0.27 

10 

9 

51085 

4 

0 

9 

16 

-0.27 

0.23 

0.49 

-0.39 

10 

10 

50339 

* 

-1 

4712 

99 

0.9 

0.02 

0 

0.02 

10 

10 

50339 

1 

1 

26 

53 

1.27 

0.23 

1 

0.53 

10 

10 

50339 

2 

0 

9 

18 

-0.43 

0.27 

0.51 

-0.41 

10 

10 

50339 

3 

0 

7 

14 

0.24 

0.33 

1.07 

-0.13 

10 

10 

50339 

4 

0 

7 

14 

0.14 

0.49 

1.37 

-0.17 

10 

11 

5NBT413 

* 

-1 

4642 

98 

0.89 

0.02 

0 

-0.07 

10 

11 

5NBT413 

1 

1 

66 

55 

1.87 

0.15 

1.01 

0.41 

10 

11 

5NBT413 

2 

0 

20 

17 

0.96 

0.16 

0.93 

-0.2 

10 

11 

5NBT413 

3 

0 

33 

28 

0.92 

0.12 

0.85 

-0.3 

10 

11 

5NBT413 

4 

0 

0 

0 

0 

0 

0 

0 

10 

12 

50076 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.02 

10 

12 

50076 

1 

1 

40 

78 

0.8 

0.2 

1.01 

0.32 

10 

12 

50076 

2 

0 

2 

4 

-0.52 

0.02 

0.48 

-0.18 

10 

12 

50076 

3 

0 

5 

10 

0.37 

0.55 

2.13 

-0.06 

10 

12 

50076 

4 

0 

4 

8 

-0.67 

0.35 

0.49 

-0.3 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

13 

50357 

* 

-1 

4706 

99 

0.9 

0.02 

0 

0.01 

10 

13 

50357 

1 

1 

41 

75 

0.98 

0.17 

1.15 

0.34 

10 

13 

50357 

2 

0 

5 

9 

-0.23 

0.21 

0.5 

-0.31 

10 

13 

50357 

3 

0 

3 

5 

0.45 

0.65 

1.29 

-0.07 

10 

13 

50357 

4 

0 

6 

11 

0.37 

0.2 

0.94 

-0.13 

10 

14 

50690 

* 

-1 

4711 

99 

0.91 

0.02 

0 

0.03 

10 

14 

50690 

1 

1 

25 

50 

1.3 

0.31 

1.18 

0.46 

10 

14 

50690 

2 

0 

10 

20 

-0.21 

0.34 

0.87 

-0.22 

10 

14 

50690 

3 

0 

9 

18 

0.22 

0.42 

1.59 

-0.09 

10 

14 

50690 

4 

0 

6 

12 

-0.94 

0.8 

0.59 

-0.33 

10 

15 

5NF48 

* 

-1 

4645 

98 

0.89 

0.02 

0 

-0.07 

10 

15 

5NF48 

1 

1 

66 

57 

1.93 

0.14 

0.87 

0.47 

10 

15 

5NF48 

2 

0 

23 

20 

0.82 

0.12 

0.72 

-0.29 

10 

15 

5NF48 

3 

0 

27 

23 

0.9 

0.16 

0.9 

-0.28 

10 

15 

5NF48 

4 

0 

0 

0 

0 

0 

0 

0 

10 

16 

5NF45 

* 

-1 

4662 

98 

0.89 

0.02 

0 

-0.05 

10 

16 

5NF45 

1 

1 

45 

45 

1.78 

0.18 

1.14 

0.36 

10 

16 

5NF45 

2 

0 

35 

35 

1.01 

0.15 

1.04 

-0.25 

10 

16 

5NF45 

3 

0 

19 

19 

1.03 

0.14 

0.88 

-0.15 

10 

16 

5NF45 

4 

0 

0 

0 

0 

0 

0 

0 

10 

17 

50129 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.04 

10 

17 

50129 

1 

1 

45 

88 

0.42 

0.17 

1.07 

0.05 

10 

17 

50129 

2 

0 

0 

0 

0 

0 

0 

0 

10 

17 

50129 

3 

0 

4 

8 

-0.2 

0.25 

0.86 

-0.16 

10 

17 

50129 

4 

0 

2 

4 

1.12 

0.19 

2.99 

0.13 

10 

18 

50590 

* 

-1 

4713 

99 

0.91 

0.02 

0 

0.05 

10 

18 

50590 

1 

1 

36 

75 

0.62 

0.14 

0.83 

0.58 

10 

18 

50590 

2 

0 

2 

4 

-1.88 

0.45 

0.16 

-0.44 

10 

18 

50590 

3 

0 

4 

8 

-0.71 

0.25 

0.51 

-0.29 

10 

18 

50590 

4 

0 

6 

13 

-0.43 

0.34 

0.9 

-0.26 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

19 

50745 

* 

-1 

4712 

99 

0.91 

0.02 

0 

0.04 

10 

19 

50745 

1 

1 

29 

59 

0.71 

0.18 

0.96 

0.43 

10 

19 

50745 

2 

0 

1 

2 

-1.41 

0 

0.19 

-0.26 

10 

19 

50745 

3 

0 

16 

33 

-0.05 

0.22 

1.04 

-0.3 

10 

19 

50745 

4 

0 

3 

6 

-0.13 

0.09 

0.67 

-0.13 

10 

20 

50409 

* 

-1 

4712 

99 

0.9 

0.02 

0 

0.02 

10 

20 

50409 

1 

1 

28 

57 

1.17 

0.28 

1.1 

0.44 

10 

20 

50409 

2 

0 

11 

22 

0.2 

0.28 

1.21 

-0.17 

10 

20 

50409 

3 

0 

5 

10 

0.22 

0.22 

0.93 

-0.1 

10 

20 

50409 

4 

0 

5 

10 

-0.95 

0.23 

0.29 

-0.39 

10 

21 

50449 

* 

-1 

4702 

99 

0.91 

0.02 

0 

0.02 

10 

21 

50449 

1 

1 

28 

47 

1.18 

0.22 

1.09 

0.43 

10 

21 

50449 

2 

0 

19 

32 

0.46 

0.25 

1.4 

-0.1 

10 

21 

50449 

3 

0 

4 

7 

-0.29 

0.27 

0.43 

-0.2 

10 

21 

50449 

4 

0 

8 

14 

-0.44 

0.33 

0.45 

-0.35 

10 

22 

5MD42 

* 

-1 

4652 

98 

0.88 

0.02 

0 

-0.11 

10 

22 

5MD42 

1 

1 

65 

60 

2.25 

0.1 

0.82 

0.53 

10 

22 

5MD42 

2 

0 

27 

25 

1.52 

0.14 

0.99 

-0.21 

10 

22 

5MD42 

3 

0 

17 

16 

0.87 

0.15 

0.48 

-0.47 

10 

22 

5MD42 

4 

0 

0 

0 

0 

0 

0 

0 

10 

23 

5G119 

* 

-1 

4548 

96 

0.9 

0.02 

0 

-0.02 

10 

23 

5G119 

1 

1 

151 

71 

1.23 

0.08 

0.99 

0.37 

10 

23 

5G119 

2 

0 

3 

1 

0.12 

0.28 

0.53 

-0.11 

10 

23 

5G119 

3 

0 

59 

28 

0.49 

0.08 

0.84 

-0.34 

10 

23 

5G119 

4 

0 

0 

0 

0 

0 

0 

0 

10 

24 

5G23 

* 

-1 

4636 

97 

0.89 

0.02 

0 

-0.07 

10 

24 

5G23 

1 

1 

85 

68 

1.78 

0.13 

0.95 

0.42 

10 

24 

5G23 

2 

0 

15 

12 

1.02 

0.19 

1.02 

-0.13 

10 

24 

5G23 

3 

0 

25 

20 

0.56 

0.15 

0.64 

-0.38 

10 

24 

5G23 

4 

0 

0 

0 

0 

0 

0 

0 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

25 

5G17 

* 

-1 

4638 

97 

0.88 

0.02 

0 

-0.12 

10 

25 

5G17 

1 

1 

83 

67 

2.02 

0.1 

1.17 

0.24 

10 

25 

5G17 

2 

0 

24 

20 

1.72 

0.14 

1.18 

-0.08 

10 

25 

5G17 

3 

0 

16 

13 

1.34 

0.14 

0.75 

-0.23 

10 

25 

5G17 

4 

0 

0 

0 

0 

0 

0 

0 

10 

26 

5NBT214 

* 

-1 

4658 

98 

0.89 

0.02 

0 

-0.05 

10 

26 

5NBT214 

1 

1 

93 

90 

1.51 

0.11 

0.94 

0.34 

10 

26 

5NBT214 

2 

0 

3 

3 

0.11 

0.19 

0.42 

-0.21 

10 

26 

5NBT214 

3 

0 

7 

7 

0.35 

0.23 

0.62 

-0.26 

10 

26 

5NBT214 

4 

0 

0 

0 

0 

0 

0 

0 

10 

27 

50848 

* 

-1 

4710 

99 

0.91 

0.02 

0 

0.03 

10 

27 

50848 

1 

1 

34 

67 

0.76 

0.2 

1.01 

0.32 

10 

27 

50848 

2 

0 

5 

10 

-0.22 

0.3 

0.73 

-0.21 

10 

27 

50848 

3 

0 

6 

12 

0.43 

0.4 

1.64 

-0.02 

10 

27 

50848 

4 

0 

6 

12 

-0.25 

0.48 

1.05 

-0.24 

10 

28 

50222 

* 

-1 

4706 

99 

0.91 

0.02 

0 

0.04 

10 

28 

50222 

1 

1 

33 

60 

0.99 

0.21 

0.88 

0.54 

10 

28 

50222 

2 

0 

11 

20 

-0.67 

0.34 

0.66 

-0.42 

10 

28 

50222 

3 

0 

5 

9 

-0.18 

0.33 

0.82 

-0.14 

10 

28 

50222 

4 

0 

6 

11 

-0.27 

0.25 

0.73 

-0.18 

10 

29 

50430 

* 

-1 

4695 

99 

0.9 

0.02 

0 

0.02 

10 

29 

50430 

1 

1 

34 

52 

1.27 

0.17 

0.89 

0.47 

10 

29 

50430 

2 

0 

21 

32 

0.32 

0.23 

1.1 

-0.22 

10 

29 

50430 

3 

0 

3 

5 

0.26 

0.61 

0.92 

-0.08 

10 

29 

50430 

4 

0 

8 

12 

-0.51 

0.51 

0.74 

-0.37 

10 

30 

51027 

* 

-1 

4703 

99 

0.91 

0.02 

0 

0.03 

10 

30 

51027 

1 

1 

23 

40 

1.39 

0.3 

0.98 

0.52 

10 

30 

51027 

2 

0 

17 

29 

-0.01 

0.19 

0.75 

-0.31 

10 

30 

51027 

3 

0 

9 

16 

0.15 

0.25 

0.88 

-0.15 

10 

30 

51027 

4 

0 

9 

16 

0.12 

0.28 

0.84 

-0.16 



easyCBM CCSS Fifth Grade Math Measure Development 


139 

Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

1 

50A212 

* 

-1 

4650 

98 

0.88 

0.02 

0.00 

-0.11 

BMF 

1 

50A212 

1 

1 

87 

78 

2.09 

0.08 

0.89 

0.48 

BMF 

1 

50A212 

2 

0 

8 

7 

1.26 

0.22 

0.77 

-0.21 

BMF 

1 

50A212 

3 

0 

16 

14 

1.05 

0.14 

0.60 

-0.41 

BMF 

1 

50A212 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

2 

50 A3 8 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

BMF 

2 

50 A3 8 

1 

1 

53 

53 

1.69 

0.13 

1.11 

0.28 

BMF 

2 

50 A3 8 

2 

0 

18 

18 

1.18 

0.16 

0.99 

-0.15 

BMF 

2 

50 A3 8 

3 

0 

29 

29 

1.22 

0.15 

1.12 

-0.18 

BMF 

2 

50 A3 8 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

3 

50A22 

* 

-1 

4556 

96 

0.88 

0.02 

0.00 

-0.09 

BMF 

3 

50A22 

1 

1 

98 

48 

1.90 

0.10 

0.95 

0.43 

BMF 

3 

50A22 

2 

0 

65 

32 

1.00 

0.07 

0.81 

-0.32 

BMF 

3 

50A22 

3 

0 

42 

20 

1.14 

0.13 

1.06 

-0.17 

BMF 

3 

50A22 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

4 

5OA130 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

BMF 

4 

5OA130 

1 

1 

42 

42 

2.08 

0.14 

1.12 

0.32 

BMF 

4 

5OA130 

2 

0 

40 

40 

1.70 

0.13 

1.25 

-0.03 

BMF 

4 

5OA130 

3 

0 

17 

17 

0.95 

0.24 

0.75 

-0.37 

BMF 

4 

5OA130 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

5 

50311 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

BMF 

5 

50311 

1 

1 

33 

69 

0.88 

0.21 

0.96 

0.57 

BMF 

5 

50311 

2 

0 

4 

8 

-1.02 

0.65 

0.59 

-0.31 

BMF 

5 

50311 

3 

0 

8 

17 

-0.75 

0.30 

0.63 

-0.37 

BMF 

5 

50311 

4 

0 

3 

6 

-0.57 

0.39 

0.62 

-0.18 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

6 

5NBT517 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

BMF 

6 

5NBT517 

1 

1 

90 

87 

1.92 

0.12 

0.93 

0.34 

BMF 

6 

5NBT517 

2 

0 

5 

5 

0.65 

0.41 

0.67 

-0.22 

BMF 

6 

5NBT517 

3 

0 

9 

9 

0.84 

0.24 

0.74 

-0.25 

BMF 

6 

5NBT517 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

7 

50914 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.00 

BMF 

7 

50914 

1 

1 

33 

69 

1.39 

0.30 

3.17 

0.46 

BMF 

7 

50914 

2 

0 

8 

17 

-0.13 

0.19 

0.63 

-0.28 

BMF 

7 

50914 

3 

0 

3 

6 

-0.57 

0.68 

0.58 

-0.23 

BMF 

7 

50914 

4 

0 

4 

8 

-0.19 

0.21 

0.57 

-0.20 

BMF 

8 

50183 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.04 

BMF 

8 

50183 

1 

1 

33 

59 

1.07 

0.18 

0.68 

0.61 

BMF 

8 

50183 

2 

0 

7 

13 

-0.34 

0.37 

0.76 

-0.22 

BMF 

8 

50183 

3 

0 

8 

14 

-0.37 

0.22 

0.61 

-0.25 

BMF 

8 

50183 

4 

0 

8 

14 

-0.83 

0.53 

0.57 

-0.39 

BMF 

9 

5NBT55 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.11 

BMF 

9 

5NBT55 

1 

1 

80 

81 

2.03 

0.10 

0.96 

0.34 

BMF 

9 

5NBT55 

2 

0 

9 

9 

0.94 

0.19 

0.56 

-0.33 

BMF 

9 

5NBT55 

3 

0 

10 

10 

1.51 

0.31 

1.38 

-0.13 

BMF 

9 

5NBT55 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

10 

5NBT518 

* 

-1 

4524 

95 

0.86 

0.02 

0.00 

-0.14 

BMF 

10 

5NBT518 

1 

1 

174 

73 

1.98 

0.08 

0.97 

0.41 

BMF 

10 

5NBT518 

2 

0 

24 

10 

0.83 

0.11 

0.64 

-0.26 

BMF 

10 

5NBT518 

3 

0 

39 

16 

0.98 

0.15 

1.07 

-0.28 

BMF 

10 

5NBT518 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

11 

5NBT512 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

BMF 

11 

5NBT512 

1 

1 

71 

57 

1.88 

0.14 

1.03 

0.32 

BMF 

11 

5NBT512 

2 

0 

33 

27 

1.23 

0.12 

1.02 

-0.21 

BMF 

11 

5NBT512 

3 

0 

20 

16 

1.18 

0.17 

0.97 

-0.17 

BMF 

11 

5NBT512 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

12 

50999 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

BMF 

12 

50999 

1 

1 

38 

78 

0.67 

0.16 

0.84 

0.47 

BMF 

12 

50999 

2 

0 

7 

14 

-0.46 

0.40 

0.97 

-0.30 

BMF 

12 

50999 

3 

0 

2 

4 

-0.65 

0.07 

0.48 

-0.19 

BMF 

12 

50999 

4 

0 

2 

4 

-1.09 

1.53 

0.75 

-0.27 

BMF 

13 

50696 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

BMF 

13 

50696 

1 

1 

33 

66 

0.85 

0.22 

0.93 

0.47 

BMF 

13 

50696 

2 

0 

2 

4 

-0.18 

0.89 

1.02 

-0.10 

BMF 

13 

50696 

3 

0 

10 

20 

-0.38 

0.27 

0.83 

-0.32 

BMF 

13 

50696 

4 

0 

5 

10 

-0.51 

0.29 

0.58 

-0.25 

BMF 

14 

5NF33 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

BMF 

14 

5NF33 

1 

1 

70 

74 

1.96 

0.10 

0.90 

0.48 

BMF 

14 

5NF33 

2 

0 

16 

17 

1.16 

0.14 

0.80 

-0.28 

BMF 

14 

5NF33 

3 

0 

8 

9 

0.63 

0.15 

0.44 

-0.37 

BMF 

14 

5NF33 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

15 

5NF213 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

BMF 

15 

5NF213 

1 

1 

65 

63 

2.14 

0.14 

0.97 

0.42 

BMF 

15 

5NF213 

2 

0 

16 

15 

1.17 

0.26 

1.25 

-0.22 

BMF 

15 

5NF213 

3 

0 

23 

22 

1.13 

0.14 

0.79 

-0.30 

BMF 

15 

5NF213 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

16 

5NF611 

* 

-1 

4663 

98 

0.88 

0.02 

0.00 

-0.11 

BMF 

16 

5NF611 

1 

1 

56 

57 

2.44 

0.16 

0.95 

0.49 

BMF 

16 

5NF611 

2 

0 

19 

19 

1.34 

0.18 

0.81 

-0.27 

BMF 

16 

5NF611 

3 

0 

23 

23 

1.30 

0.13 

0.71 

-0.32 

BMF 

16 

5NF611 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

17 

50595 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

BMF 

17 

50595 

1 

1 

45 

85 

0.56 

0.19 

0.91 

0.35 

BMF 

17 

50595 

2 

0 

1 

2 

-2.44 

0.00 

0.10 

-0.29 

BMF 

17 

50595 

3 

0 

6 

11 

-0.81 

0.38 

0.73 

-0.31 

BMF 

17 

50595 

4 

0 

1 

2 

1.25 

0.00 

4.00 

0.09 

BMF 

18 

50885 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

BMF 

18 

50885 

1 

1 

38 

78 

0.72 

0.20 

1.04 

0.38 

BMF 

18 

50885 

2 

0 

3 

6 

-0.44 

0.49 

0.73 

-0.19 

BMF 

18 

50885 

3 

0 

1 

2 

0.29 

0.00 

1.18 

-0.02 

BMF 

18 

50885 

4 

0 

7 

14 

-0.48 

0.41 

0.91 

-0.31 

BMF 

19 

51017 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

BMF 

19 

51017 

1 

1 

31 

61 

0.80 

0.18 

0.97 

0.40 

BMF 

19 

51017 

2 

0 

13 

25 

0.24 

0.25 

1.37 

-0.13 

BMF 

19 

51017 

3 

0 

5 

10 

-0.56 

0.37 

0.50 

-0.33 

BMF 

19 

51017 

4 

0 

2 

4 

-0.62 

0.51 

0.43 

-0.21 

BMF 

20 

50733 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

BMF 

20 

50733 

1 

1 

26 

54 

0.85 

0.19 

0.92 

0.42 

BMF 

20 

50733 

2 

0 

7 

15 

0.09 

0.41 

1.38 

-0.12 

BMF 

20 

50733 

3 

0 

8 

17 

0.11 

0.41 

1.19 

-0.13 

BMF 

20 

50733 

4 

0 

7 

15 

-0.45 

0.39 

0.64 

-0.33 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

21 

5MD414 

* 

-1 

4646 

98 

0.89 

0.02 

0.00 

-0.04 

BMF 

21 

5MD414 

1 

1 

67 

58 

1.56 

0.12 

0.93 

0.40 

BMF 

21 

5MD414 

2 

0 

30 

26 

0.88 

0.15 

1.08 

-0.20 

BMF 

21 

5MD414 

3 

0 

18 

16 

0.53 

0.22 

0.88 

-0.29 

BMF 

21 

5MD414 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

22 

51050 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

BMF 

22 

51050 

1 

1 

19 

36 

1.53 

0.32 

1.18 

0.52 

BMF 

22 

51050 

2 

0 

14 

26 

0.52 

0.19 

0.97 

-0.12 

BMF 

22 

51050 

3 

0 

12 

23 

0.38 

0.17 

0.80 

-0.18 

BMF 

22 

51050 

4 

0 

8 

15 

-0.15 

0.21 

0.46 

-0.33 

BMF 

23 

5G410 

* 

-1 

4654 

98 

0.89 

0.02 

0.00 

-0.05 

BMF 

23 

5G410 

1 

1 

81 

76 

1.67 

0.11 

0.88 

0.48 

BMF 

23 

5G410 

2 

0 

15 

14 

0.58 

0.16 

0.69 

-0.31 

BMF 

23 

5G410 

3 

0 

11 

10 

0.39 

0.13 

0.52 

-0.32 

BMF 

23 

5G410 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

24 

5G310 

* 

-1 

4636 

97 

0.89 

0.02 

0.00 

-0.04 

BMF 

24 

5G310 

1 

1 

83 

66 

1.54 

0.11 

0.92 

0.43 

BMF 

24 

5G310 

2 

0 

28 

22 

0.67 

0.14 

0.88 

-0.29 

BMF 

24 

5G310 

3 

0 

14 

11 

0.51 

0.21 

0.77 

-0.25 

BMF 

24 

5G310 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

25 

5G46 

* 

-1 

4639 

97 

0.89 

0.02 

0.00 

-0.07 

BMF 

25 

5G46 

1 

1 

72 

59 

1.82 

0.15 

1.09 

0.37 

BMF 

25 

5G46 

2 

0 

20 

16 

0.75 

0.14 

0.73 

-0.28 

BMF 

25 

5G46 

3 

0 

30 

25 

1.10 

0.13 

1.06 

-0.19 

BMF 

25 

5G46 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

26 

50 A3 4 

* 

-1 

4524 

95 

0.86 

0.02 

0.00 

-0.14 

BMF 

26 

50 A3 4 

1 

1 

219 

92 

1.78 

0.07 

0.96 

0.27 

BMF 

26 

50 A3 4 

2 

0 

12 

5 

0.76 

0.24 

0.85 

-0.19 

BMF 

26 

50 A3 4 

3 

0 

6 

3 

0.33 

0.29 

0.51 

-0.19 

BMF 

26 

50 A3 4 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

27 

5NBT25 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

BMF 

27 

5NBT25 

1 

1 

77 

82 

1.66 

0.11 

0.91 

0.44 

BMF 

27 

5NBT25 

2 

0 

12 

13 

0.60 

0.11 

0.61 

-0.32 

BMF 

27 

5NBT25 

3 

0 

5 

5 

0.26 

0.15 

0.42 

-0.28 

BMF 

27 

5NBT25 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

28 

50A11 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

BMF 

28 

50A11 

1 

1 

85 

76 

1.51 

0.10 

0.84 

0.49 

BMF 

28 

50A11 

2 

0 

20 

18 

0.41 

0.18 

0.82 

-0.37 

BMF 

28 

50A11 

3 

0 

7 

6 

0.14 

0.23 

0.50 

-0.27 

BMF 

28 

50A11 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

29 

5G412 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

BMF 

29 

5G412 

1 

1 

85 

69 

1.83 

0.12 

1.02 

0.34 

BMF 

29 

5G412 

2 

0 

16 

13 

1.01 

0.13 

0.79 

-0.22 

BMF 

29 

5G412 

3 

0 

23 

19 

1.11 

0.11 

0.85 

-0.22 

BMF 

29 

5G412 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

30 

5MD415 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

BMF 

30 

5MD415 

1 

1 

42 

44 

1.14 

0.12 

0.87 

0.44 

BMF 

30 

5MD415 

2 

0 

9 

9 

0.28 

0.20 

0.73 

-0.20 

BMF 

30 

5MD415 

3 

0 

44 

46 

0.48 

0.10 

0.92 

-0.33 

BMF 

30 

5MD415 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

31 

I6NS701 1 

* 

-1 

2484 

94 

0.35 

0.02 

0.00 

0.14 

BMF 

31 

I6NS701 1 

A 

1 

138 

85 

-0.01 

0.05 

0.95 

0.34 

BMF 

31 

I6NS701 1 

B 

0 

15 

9 

-0.57 

0.19 

0.89 

-0.24 

BMF 

31 

I6NS701 1 

C 

0 

10 

6 

-0.62 

0.08 

0.69 

-0.22 

BMF 

32 

I6NS5015 

* 

-1 

8531 

97 

0.01 

0.01 

0.00 

0.06 

BMF 

32 

I6NS5015 

A 

1 

162 

54 

0.00 

0.06 

1.01 

0.36 

BMF 

32 

I6NS5015 

B 

0 

98 

33 

-0.47 

0.05 

0.94 

-0.22 

BMF 

32 

I6NS5015 

C 

0 

40 

13 

-0.65 

0.08 

0.78 

-0.22 

BMF 

33 

I6NS5006 

* 

-1 

8638 

98 

0.01 

0.01 

0.00 

0.08 

BMF 

33 

I6NS5006 

A 

1 

79 

41 

-0.08 

0.08 

0.92 

0.39 

BMF 

33 

I6NS5006 

B 

0 

84 

44 

-0.53 

0.05 

0.96 

-0.22 

BMF 

33 

I6NS5006 

C 

0 

30 

16 

-0.72 

0.09 

0.77 

-0.23 

BMF 

34 

I6RP1023 

* 

-1 

2484 

94 

0.35 

0.02 

0.00 

0.12 

BMF 

34 

I6RP1023 

A 

1 

76 

47 

0.19 

0.07 

1.01 

0.33 

BMF 

34 

I6RP1023 

B 

0 

81 

50 

-0.20 

0.07 

1.01 

-0.26 

BMF 

34 

I6RP1023 

C 

0 

6 

4 

-0.61 

0.22 

0.62 

-0.17 

BMF 

35 

I6EE2010 

* 

-1 

8632 

98 

0.00 

0.01 

0.00 

0.02 

BMF 

35 

I6EE2010 

A 

1 

51 

26 

0.28 

0.12 

1.05 

0.27 

BMF 

35 

I6EE2010 

B 

0 

31 

16 

-0.56 

0.08 

0.61 

-0.26 

BMF 

35 

I6EE2010 

C 

0 

117 

59 

-0.11 

0.07 

1.22 

-0.05 

BMF 

36 

41093 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

0.02 

BMF 

36 

41093 

A 

1 

36 

78 

1.12 

0.17 

0.79 

0.61 

BMF 

36 

41093 

B 

0 

2 

4 

-0.87 

0.45 

0.31 

-0.29 

BMF 

36 

41093 

C 

0 

4 

9 

-0.21 

0.32 

0.64 

-0.25 

BMF 

36 

41093 

D 

0 

4 

9 

-0.93 

0.28 

0.30 

-0.43 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

37 

40A416 

* 

-1 

4765 

98 

0.98 

0.02 

0.00 

-0.08 

BMF 

37 

40A416 

A 

1 

99 

83 

1.87 

0.12 

0.87 

0.46 

BMF 

37 

40A416 

B 

0 

6 

5 

0.33 

0.34 

0.56 

-0.23 

BMF 

37 

40A416 

C 

0 

14 

12 

0.32 

0.19 

0.53 

-0.37 

BMF 

37 

40A416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

38 

4G330 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

38 

4G330 

A 

1 

65 

73 

1.84 

0.12 

0.95 

0.40 

BMF 

38 

4G330 

B 

0 

17 

19 

1.17 

0.17 

0.98 

-0.22 

BMF 

38 

4G330 

C 

0 

7 

8 

0.50 

0.17 

0.43 

-0.34 

BMF 

38 

4G330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

39 

40A29 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

39 

40A29 

A 

1 

57 

62 

1.96 

0.11 

0.82 

0.51 

BMF 

39 

40A29 

B 

0 

11 

12 

0.78 

0.17 

0.60 

-0.31 

BMF 

39 

40A29 

C 

0 

24 

26 

1.04 

0.17 

0.95 

-0.34 

BMF 

39 

40A29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

40 

40A57 

* 

-1 

4795 

98 

0.98 

0.02 

0.00 

-0.09 

BMF 

40 

40A57 

A 

1 

50 

56 

2.21 

0.13 

0.99 

0.42 

BMF 

40 

40A57 

B 

0 

9 

10 

1.28 

0.23 

0.74 

-0.21 

BMF 

40 

40A57 

C 

0 

30 

34 

1.48 

0.12 

0.89 

-0.31 

BMF 

40 

40A57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

1 

5OA220 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

BMW 

1 

5OA220 

1 

1 

81 

70 

1.71 

0.13 

1.04 

0.33 

BMW 

1 

5OA220 

2 

0 

15 

13 

0.89 

0.17 

0.88 

-0.20 

BMW 

1 

5OA220 

3 

0 

20 

17 

0.91 

0.16 

0.98 

-0.23 

BMW 

1 

5OA220 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

2 

50A217 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

BMW 

2 

50A217 

1 

1 

69 

71 

2.71 

0.13 

0.96 

0.37 

BMW 

2 

50A217 

2 

0 

14 

14 

1.66 

0.26 

0.93 

-0.27 

BMW 

2 

50A217 

3 

0 

14 

14 

1.86 

0.32 

1.43 

-0.20 

BMW 

2 

50A217 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

3 

50A115 

* 

-1 

4556 

96 

0.87 

0.02 

0.00 

-0.10 

BMW 

3 

50A115 

1 

1 

102 

50 

1.99 

0.10 

0.99 

0.46 

BMW 

3 

50A115 

2 

0 

36 

18 

0.91 

0.11 

0.69 

-0.29 

BMW 

3 

50A115 

3 

0 

67 

33 

1.19 

0.09 

0.95 

-0.25 

BMW 

3 

50A115 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

4 

50A326 

* 

-1 

4664 

98 

0.88 

0.02 

0.00 

-0.12 

BMW 

4 

50A326 

1 

1 

45 

46 

2.48 

0.18 

1.03 

0.42 

BMW 

4 

50A326 

2 

0 

31 

32 

1.43 

0.14 

0.84 

-0.33 

BMW 

4 

50A326 

3 

0 

21 

22 

1.69 

0.23 

1.29 

-0.13 

BMW 

4 

50A326 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

5 

50474 

* 

-1 

4700 

99 

0.91 

0.02 

0.00 

0.03 

BMW 

5 

50474 

1 

1 

44 

72 

0.96 

0.20 

1.03 

0.45 

BMW 

5 

50474 

2 

0 

9 

15 

0.07 

0.22 

1.04 

-0.16 

BMW 

5 

50474 

3 

0 

2 

3 

-0.74 

0.05 

0.39 

-0.18 

BMW 

5 

50474 

4 

0 

6 

10 

-0.99 

0.35 

0.40 

-0.38 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

6 

5NBT517 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

BMW 

6 

5NBT517 

1 

1 

90 

87 

1.92 

0.12 

0.93 

0.34 

BMW 

6 

5NBT517 

2 

0 

5 

5 

0.65 

0.41 

0.67 

-0.22 

BMW 

6 

5NBT517 

3 

0 

9 

9 

0.84 

0.24 

0.74 

-0.25 

BMW 

6 

5NBT517 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

7 

51074 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

BMW 

7 

51074 

1 

1 

33 

66 

1.30 

0.28 

1.32 

0.51 

BMW 

7 

51074 

2 

0 

4 

8 

-0.69 

0.40 

0.44 

-0.27 

BMW 

7 

51074 

3 

0 

6 

12 

-0.26 

0.22 

0.64 

-0.24 

BMW 

7 

51074 

4 

0 

7 

14 

-0.28 

0.32 

0.73 

-0.26 

BMW 

8 

50179 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.02 

BMW 

8 

50179 

1 

1 

34 

63 

1.28 

0.19 

0.76 

0.61 

BMW 

8 

50179 

2 

0 

8 

15 

0.23 

0.29 

1.03 

-0.15 

BMW 

8 

50179 

3 

0 

3 

6 

-0.75 

0.15 

0.30 

-0.27 

BMW 

8 

50179 

4 

0 

9 

17 

-0.70 

0.31 

0.42 

-0.48 

BMW 

9 

50004 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.06 

BMW 

9 

50004 

1 

1 

25 

48 

0.56 

0.22 

0.99 

0.39 

BMW 

9 

50004 

2 

0 

5 

10 

-0.35 

0.50 

0.90 

-0.15 

BMW 

9 

50004 

3 

0 

16 

31 

-0.29 

0.20 

0.89 

-0.27 

BMW 

9 

50004 

4 

0 

6 

12 

-0.12 

0.42 

1.22 

-0.09 

BMW 

10 

5NBT518 

* 

-1 

4524 

95 

0.86 

0.02 

0.00 

-0.14 

BMW 

10 

5NBT518 

1 

1 

174 

73 

1.98 

0.08 

0.97 

0.41 

BMW 

10 

5NBT518 

2 

0 

24 

10 

0.83 

0.11 

0.64 

-0.26 

BMW 

10 

5NBT518 

3 

0 

39 

16 

0.98 

0.15 

1.07 

-0.28 

BMW 

10 

5NBT518 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

11 

5NBT33 

* 

-1 

4648 

98 

0.89 

0.02 

0.00 

-0.04 

BMW 

11 

5NBT33 

1 

1 

57 

50 

1.66 

0.14 

0.99 

0.43 

BMW 

11 

5NBT33 

2 

0 

46 

41 

0.93 

0.11 

1.11 

-0.24 

BMW 

11 

5NBT33 

3 

0 

10 

9 

0.14 

0.19 

0.43 

-0.33 

BMW 

11 

5NBT33 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

12 

50542 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

BMW 

12 

50542 

1 

1 

38 

78 

0.52 

0.14 

0.90 

0.41 

BMW 

12 

50542 

2 

0 

6 

12 

-0.18 

0.36 

1.06 

-0.19 

BMW 

12 

50542 

3 

0 

2 

4 

-1.03 

0.08 

0.33 

-0.29 

BMW 

12 

50542 

4 

0 

3 

6 

-0.45 

0.84 

1.18 

-0.20 

BMW 

13 

50232 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.00 

BMW 

13 

50232 

1 

1 

37 

73 

1.28 

0.20 

0.78 

0.52 

BMW 

13 

50232 

2 

0 

9 

18 

-0.47 

0.39 

0.89 

-0.45 

BMW 

13 

50232 

3 

0 

4 

8 

-0.09 

0.43 

0.73 

-0.21 

BMW 

13 

50232 

4 

0 

1 

2 

0.56 

0.00 

1.08 

-0.03 

BMW 

14 

5NF65 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

BMW 

14 

5NF65 

1 

1 

80 

69 

1.77 

0.13 

0.95 

0.40 

BMW 

14 

5NF65 

2 

0 

12 

10 

0.56 

0.17 

0.59 

-0.28 

BMW 

14 

5NF65 

3 

0 

24 

21 

0.93 

0.14 

0.94 

-0.25 

BMW 

14 

5NF65 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

15 

5NF213 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

BMW 

15 

5NF213 

1 

1 

65 

63 

2.14 

0.14 

0.97 

0.42 

BMW 

15 

5NF213 

2 

0 

16 

15 

1.17 

0.26 

1.25 

-0.22 

BMW 

15 

5NF213 

3 

0 

23 

22 

1.13 

0.14 

0.79 

-0.30 

BMW 

15 

5NF213 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

16 

5NF210 

* 

-1 

4653 

98 

0.88 

0.02 

0.00 

-0.12 

BMW 

16 

5NF210 

1 

1 

62 

57 

2.54 

0.10 

0.66 

0.66 

BMW 

16 

5NF210 

2 

0 

32 

30 

1.19 

0.15 

0.87 

-0.45 

BMW 

16 

5NF210 

3 

0 

14 

13 

0.91 

0.22 

0.54 

-0.37 

BMW 

16 

5NF210 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

17 

50595 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

BMW 

17 

50595 

1 

1 

45 

85 

0.56 

0.19 

0.91 

0.35 

BMW 

17 

50595 

2 

0 

1 

2 

-2.44 

0.00 

0.10 

-0.29 

BMW 

17 

50595 

3 

0 

6 

11 

-0.81 

0.38 

0.73 

-0.31 

BMW 

17 

50595 

4 

0 

1 

2 

1.25 

0.00 

4.00 

0.09 

BMW 

18 

50422 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

BMW 

18 

50422 

1 

1 

39 

76 

0.61 

0.19 

1.06 

0.35 

BMW 

18 

50422 

2 

0 

1 

2 

-0.55 

0.00 

0.54 

-0.11 

BMW 

18 

50422 

3 

0 

2 

4 

-0.97 

0.09 

0.36 

-0.24 

BMW 

18 

50422 

4 

0 

9 

18 

-0.18 

0.27 

0.99 

-0.23 

BMW 

19 

51019 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

BMW 

19 

51019 

1 

1 

36 

65 

1.08 

0.19 

1.07 

0.43 

BMW 

19 

51019 

2 

0 

14 

25 

0.21 

0.19 

0.87 

-0.23 

BMW 

19 

51019 

3 

0 

3 

5 

0.14 

0.40 

0.76 

-0.11 

BMW 

19 

51019 

4 

0 

2 

4 

-1.95 

2.04 

0.32 

-0.42 

BMW 

20 

5MD46 

* 

-1 

4640 

97 

0.89 

0.02 

0.00 

-0.07 

BMW 

20 

5MD46 

1 

1 

88 

73 

1.75 

0.12 

0.92 

0.43 

BMW 

20 

5MD46 

2 

0 

16 

13 

0.46 

0.16 

0.60 

-0.34 

BMW 

20 

5MD46 

3 

0 

17 

14 

0.86 

0.13 

0.87 

-0.21 

BMW 

20 

5MD46 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

21 

5MD414 

* 

-1 

4646 

98 

0.89 

0.02 

0.00 

-0.04 

BMW 

21 

5MD414 

1 

1 

67 

58 

1.56 

0.12 

0.93 

0.40 

BMW 

21 

5MD414 

2 

0 

30 

26 

0.88 

0.15 

1.08 

-0.20 

BMW 

21 

5MD414 

3 

0 

18 

16 

0.53 

0.22 

0.88 

-0.29 

BMW 

21 

5MD414 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

22 

50148 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.02 

BMW 

22 

50148 

1 

1 

21 

38 

1.59 

0.26 

1.10 

0.46 

BMW 

22 

50148 

2 

0 

21 

38 

0.43 

0.25 

1.18 

-0.11 

BMW 

22 

50148 

3 

0 

13 

23 

0.07 

0.22 

0.57 

-0.21 

BMW 

22 

50148 

4 

0 

1 

2 

-6.39 

0.00 

0.00 

-0.61 

BMW 

23 

5G26 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

BMW 

23 

5G26 

1 

1 

77 

77 

1.65 

0.12 

0.98 

0.36 

BMW 

23 

5G26 

2 

0 

15 

15 

0.78 

0.14 

0.74 

-0.28 

BMW 

23 

5G26 

3 

0 

8 

8 

0.82 

0.23 

0.80 

-0.19 

BMW 

23 

5G26 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

24 

5G47 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.12 

BMW 

24 

5G47 

1 

1 

88 

78 

2.27 

0.10 

0.80 

0.59 

BMW 

24 

5G47 

2 

0 

15 

13 

0.73 

0.18 

0.52 

-0.44 

BMW 

24 

5G47 

3 

0 

10 

9 

0.74 

0.20 

0.47 

-0.35 

BMW 

24 

5G47 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

25 

5G416 

* 

-1 

4655 

98 

0.89 

0.02 

0.00 

-0.06 

BMW 

25 

5G416 

1 

1 

64 

60 

1.77 

0.11 

0.98 

0.39 

BMW 

25 

5G416 

2 

0 

26 

25 

1.04 

0.18 

1.62 

-0.27 

BMW 

25 

5G416 

3 

0 

16 

15 

1.02 

0.12 

0.81 

-0.21 

BMW 

25 

5G416 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

26 

50192 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.01 

BMW 

26 

50192 

1 

1 

48 

83 

0.99 

0.19 

0.96 

0.36 

BMW 

26 

50192 

2 

0 

2 

3 

-0.48 

0.82 

0.63 

-0.18 

BMW 

26 

50192 

3 

0 

5 

9 

0.35 

0.40 

1.33 

-0.10 

BMW 

26 

50192 

4 

0 

3 

5 

-1.18 

0.46 

0.29 

-0.35 

BMW 

27 

50109 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

BMW 

27 

50109 

1 

1 

33 

63 

1.02 

0.21 

0.88 

0.55 

BMW 

27 

50109 

2 

0 

8 

15 

-0.50 

0.30 

0.69 

-0.29 

BMW 

27 

50109 

3 

0 

7 

13 

-0.51 

0.53 

1.25 

-0.27 

BMW 

27 

50109 

4 

0 

4 

8 

-0.73 

0.51 

0.58 

-0.25 

BMW 

28 

5NBT53 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

BMW 

28 

5NBT53 

1 

1 

97 

86 

2.04 

0.08 

0.88 

0.46 

BMW 

28 

5NBT53 

2 

0 

10 

9 

0.94 

0.21 

0.60 

-0.35 

BMW 

28 

5NBT53 

3 

0 

6 

5 

0.94 

0.17 

0.52 

-0.27 

BMW 

28 

5NBT53 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

29 

50A229 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

BMW 

29 

50A229 

1 

1 

71 

72 

2.03 

0.10 

0.95 

0.50 

BMW 

29 

50A229 

2 

0 

13 

13 

1.00 

0.22 

0.75 

-0.30 

BMW 

29 

50A229 

3 

0 

15 

15 

0.96 

0.18 

0.70 

-0.34 

BMW 

29 

50A229 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

30 

5NF79 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.10 

BMW 

30 

5NF79 

1 

1 

66 

65 

2.13 

0.15 

1.02 

0.41 

BMW 

30 

5NF79 

2 

0 

18 

18 

1.47 

0.17 

1.10 

-0.13 

BMW 

30 

5NF79 

3 

0 

18 

18 

0.83 

0.17 

0.64 

-0.38 

BMW 

30 

5NF79 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

31 

I6NS2002 

* 

-1 

2484 

94 

0.35 

0.02 

0.00 

0.13 

BMW 

31 

I6NS2002 

A 

1 

138 

85 

0.05 

0.06 

0.94 

0.36 

BMW 

31 

I6NS2002 

B 

0 

8 

5 

-0.78 

0.18 

0.64 

-0.23 

BMW 

31 

I6NS2002 

C 

0 

17 

10 

-0.59 

0.14 

0.83 

-0.26 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

32 

I6NS4016 

* 

-1 

2482 

94 

0.35 

0.02 

0.00 

0.13 

BMW 

32 

I6NS4016 

A 

1 

96 

58 

0.24 

0.07 

0.89 

0.47 

BMW 

32 

I6NS4016 

B 

0 

42 

25 

-0.40 

0.08 

0.85 

-0.29 

BMW 

32 

I6NS4016 

C 

0 

27 

16 

-0.52 

0.12 

0.78 

-0.29 

BMW 

33 

I6NS5006 

* 

-1 

8638 

98 

0.01 

0.01 

0.00 

0.08 

BMW 

33 

I6NS5006 

A 

1 

79 

41 

-0.08 

0.08 

0.92 

0.39 

BMW 

33 

I6NS5006 

B 

0 

84 

44 

-0.53 

0.05 

0.96 

-0.22 

BMW 

33 

I6NS5006 

C 

0 

30 

16 

-0.72 

0.09 

0.77 

-0.23 

BMW 

34 

I6NS5003 

* 

-1 

2483 

94 

0.35 

0.02 

0.00 

0.11 

BMW 

34 

I6NS5003 

A 

1 

76 

46 

0.32 

0.08 

0.90 

0.44 

BMW 

34 

I6NS5003 

B 

0 

27 

16 

-0.49 

0.11 

0.72 

-0.30 

BMW 

34 

I6NS5003 

C 

0 

61 

37 

-0.22 

0.08 

0.97 

-0.22 

BMW 

35 

I6SP2031 

* 

-1 

8431 

95 

0.01 

0.01 

0.00 

0.09 

BMW 

35 

I6SP2031 

A 

1 

85 

21 

-0.10 

0.07 

1.07 

0.17 

BMW 

35 

I6SP2031 

B 

0 

112 

28 

-0.23 

0.05 

1.17 

0.06 

BMW 

35 

I6SP2031 

C 

0 

203 

51 

-0.40 

0.04 

0.98 

-0.19 

BMW 

36 

40297 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.01 

BMW 

36 

40297 

A 

1 

47 

78 

1.23 

0.20 

0.95 

0.51 

BMW 

36 

40297 

B 

0 

12 

20 

-0.49 

0.30 

0.64 

-0.45 

BMW 

36 

40297 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

36 

40297 

D 

0 

1 

2 

-1.78 

0.00 

0.12 

-0.23 

BMW 

37 

40A412 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

BMW 

37 

40A412 

A 

1 

74 

83 

1.60 

0.12 

0.97 

0.32 

BMW 

37 

40A412 

B 

0 

9 

10 

0.86 

0.18 

0.85 

-0.20 

BMW 

37 

40A412 

C 

0 

6 

7 

0.56 

0.17 

0.58 

-0.24 

BMW 

37 

40A412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

38 

4G119 

* 

-1 

4771 

98 

0.99 

0.02 

0.00 

-0.06 

BMW 

38 

4G119 

A 

1 

82 

73 

1.54 

0.11 

1.33 

0.01 

BMW 

38 

4G119 

B 

0 

6 

5 

1.48 

0.32 

1.51 

-0.02 

BMW 

38 

4G119 

C 

0 

25 

22 

1.52 

0.14 

1.57 

-0.01 

BMW 

38 

4G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

39 

40A124 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

BMW 

39 

40A124 

A 

1 

66 

62 

2.01 

0.14 

0.95 

0.40 

BMW 

39 

40A124 

B 

0 

16 

15 

1.03 

0.20 

0.89 

-0.24 

BMW 

39 

40A124 

C 

0 

24 

23 

1.14 

0.16 

0.94 

-0.26 

BMW 

39 

40A124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

40 

40A311 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

BMW 

40 

40A311 

A 

1 

36 

40 

1.41 

0.18 

1.24 

0.27 

BMW 

40 

40A311 

B 

0 

16 

18 

0.88 

0.22 

1.13 

-0.10 

BMW 

40 

40A311 

C 

0 

38 

42 

0.88 

0.12 

1.18 

-0.19 

BMW 

40 

40A311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

1 

50A24 

* 

-1 

4643 

98 

0.89 

0.02 

0.00 

-0.08 

BMS 

1 

50A24 

1 

1 

85 

72 

1.78 

0.12 

0.95 

0.37 

BMS 

1 

50A24 

2 

0 

14 

12 

0.83 

0.21 

0.81 

-0.26 

BMS 

1 

50A24 

3 

0 

19 

16 

1.05 

0.09 

0.79 

-0.22 

BMS 

1 

50A24 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

2 

50A311 

* 

-1 

4556 

96 

0.90 

0.02 

0.00 

-0.02 

BMS 

2 

50A311 

1 

1 

89 

43 

1.37 

0.11 

1.09 

0.34 

BMS 

2 

50A311 

2 

0 

73 

36 

0.83 

0.09 

1.14 

-0.13 

BMS 

2 

50A311 

3 

0 

43 

21 

0.54 

0.10 

0.78 

-0.25 

BMS 

2 

50A311 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

3 

50A115 

* 

-1 

4556 

96 

0.87 

0.02 

0.00 

-0.10 

BMS 

3 

50A115 

1 

1 

102 

50 

1.99 

0.10 

0.99 

0.46 

BMS 

3 

50A115 

2 

0 

36 

18 

0.91 

0.11 

0.69 

-0.29 

BMS 

3 

50A115 

3 

0 

67 

33 

1.19 

0.09 

0.95 

-0.25 

BMS 

3 

50A115 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

4 

50A329 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

BMS 

4 

50A329 

1 

1 

42 

42 

2.18 

0.14 

1.01 

0.40 

BMS 

4 

50A329 

2 

0 

26 

26 

1.56 

0.18 

1.13 

-0.11 

BMS 

4 

50A329 

3 

0 

31 

31 

1.27 

0.15 

0.81 

-0.33 

BMS 

4 

50A329 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

5 

50464 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

BMS 

5 

50464 

1 

1 

37 

73 

0.69 

0.20 

1.26 

0.26 

BMS 

5 

50464 

2 

0 

4 

8 

0.05 

0.52 

1.13 

-0.12 

BMS 

5 

50464 

3 

0 

4 

8 

0.03 

0.38 

1.01 

-0.12 

BMS 

5 

50464 

4 

0 

6 

12 

-0.01 

0.43 

1.10 

-0.16 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

6 

50782 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.07 

BMS 

6 

50782 

1 

1 

28 

58 

0.41 

0.22 

0.98 

0.45 

BMS 

6 

50782 

2 

0 

10 

21 

-0.17 

0.25 

1.24 

-0.06 

BMS 

6 

50782 

3 

0 

6 

13 

-1.38 

0.38 

0.40 

-0.43 

BMS 

6 

50782 

4 

0 

4 

8 

-0.78 

0.25 

0.58 

-0.19 

BMS 

7 

50016 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

BMS 

7 

50016 

1 

1 

36 

68 

1.25 

0.19 

0.93 

0.55 

BMS 

7 

50016 

2 

0 

5 

9 

-0.84 

0.40 

0.39 

-0.39 

BMS 

7 

50016 

3 

0 

9 

17 

0.16 

0.35 

1.17 

-0.21 

BMS 

7 

50016 

4 

0 

3 

6 

-0.71 

0.52 

0.39 

-0.27 

BMS 

8 

50476 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

BMS 

8 

50476 

1 

1 

31 

60 

1.09 

0.21 

0.84 

0.54 

BMS 

8 

50476 

2 

0 

15 

29 

-0.16 

0.21 

0.85 

-0.34 

BMS 

8 

50476 

3 

0 

1 

2 

-1.04 

0.00 

0.26 

-0.17 

BMS 

8 

50476 

4 

0 

5 

10 

-0.68 

0.66 

0.97 

-0.31 

BMS 

9 

50628 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.02 

BMS 

9 

50628 

1 

1 

31 

58 

0.99 

0.15 

0.86 

0.51 

BMS 

9 

50628 

2 

0 

6 

11 

0.44 

0.32 

1.21 

-0.07 

BMS 

9 

50628 

3 

0 

9 

17 

0.03 

0.18 

0.68 

-0.30 

BMS 

9 

50628 

4 

0 

7 

13 

-0.18 

0.25 

0.60 

-0.35 

BMS 

10 

50786 

* 

-1 

4488 

94 

0.86 

0.02 

0.00 

-0.14 

BMS 

10 

50786 

1 

1 

197 

72 

2.12 

0.08 

0.81 

0.54 

BMS 

10 

50786 

2 

0 

26 

10 

0.67 

0.19 

0.83 

-0.25 

BMS 

10 

50786 

3 

0 

39 

14 

0.59 

0.17 

0.67 

-0.33 

BMS 

10 

50786 

4 

0 

11 

4 

-0.10 

0.18 

0.28 

-0.27 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

11 

5NBT33 

* 

-1 

4648 

98 

0.89 

0.02 

0.00 

-0.04 

BMS 

11 

5NBT33 

1 

1 

57 

50 

1.66 

0.14 

0.99 

0.43 

BMS 

11 

5NBT33 

2 

0 

46 

41 

0.93 

0.11 

1.11 

-0.24 

BMS 

11 

5NBT33 

3 

0 

10 

9 

0.14 

0.19 

0.43 

-0.33 

BMS 

11 

5NBT33 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

12 

50542 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

BMS 

12 

50542 

1 

1 

38 

78 

0.52 

0.14 

0.90 

0.41 

BMS 

12 

50542 

2 

0 

6 

12 

-0.18 

0.36 

1.06 

-0.19 

BMS 

12 

50542 

3 

0 

2 

4 

-1.03 

0.08 

0.33 

-0.29 

BMS 

12 

50542 

4 

0 

3 

6 

-0.45 

0.84 

1.18 

-0.20 

BMS 

13 

50382 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

BMS 

13 

50382 

1 

1 

35 

67 

0.94 

0.23 

1.01 

0.39 

BMS 

13 

50382 

2 

0 

13 

25 

0.05 

0.27 

1.30 

-0.22 

BMS 

13 

50382 

3 

0 

2 

4 

-1.36 

0.37 

0.22 

-0.28 

BMS 

13 

50382 

4 

0 

2 

4 

-0.68 

0.42 

0.44 

-0.18 

BMS 

14 

50540 

* 

-1 

4479 

94 

0.86 

0.02 

0.00 

-0.12 

BMS 

14 

50540 

1 

1 

199 

71 

1.84 

0.07 

1.01 

0.46 

BMS 

14 

50540 

2 

0 

36 

13 

0.68 

0.14 

0.71 

-0.30 

BMS 

14 

50540 

3 

0 

22 

8 

1.35 

0.23 

1.68 

-0.05 

BMS 

14 

50540 

4 

0 

25 

9 

0.36 

0.15 

0.49 

-0.34 

BMS 

15 

5NF69 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.10 

BMS 

15 

5NF69 

1 

1 

64 

63 

2.13 

0.15 

1.06 

0.39 

BMS 

15 

5NF69 

2 

0 

10 

10 

0.42 

0.11 

0.32 

-0.39 

BMS 

15 

5NF69 

3 

0 

28 

27 

1.49 

0.13 

1.12 

-0.16 

BMS 

15 

5NF69 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

16 

5NF29 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

BMS 

16 

5NF29 

1 

1 

61 

49 

2.04 

0.15 

0.98 

0.43 

BMS 

16 

5NF29 

2 

0 

51 

41 

1.16 

0.09 

0.87 

-0.35 

BMS 

16 

5NF29 

3 

0 

12 

10 

1.16 

0.12 

0.76 

-0.14 

BMS 

16 

5NF29 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

17 

50107 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.07 

BMS 

17 

50107 

1 

1 

43 

83 

0.23 

0.14 

0.80 

0.38 

BMS 

17 

50107 

2 

0 

3 

6 

0.22 

1.00 

3.11 

0.04 

BMS 

17 

50107 

3 

0 

3 

6 

-1.70 

0.19 

0.25 

-0.38 

BMS 

17 

50107 

4 

0 

3 

6 

-1.28 

1.33 

1.05 

-0.29 

BMS 

18 

50108 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

BMS 

18 

50108 

1 

1 

38 

79 

0.98 

0.23 

0.92 

0.42 

BMS 

18 

50108 

2 

0 

3 

6 

-0.48 

0.37 

0.59 

-0.21 

BMS 

18 

50108 

3 

0 

2 

4 

-1.21 

0.03 

0.25 

-0.28 

BMS 

18 

50108 

4 

0 

5 

10 

-0.20 

0.33 

0.83 

-0.21 

BMS 

19 

50593 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

BMS 

19 

50593 

1 

1 

30 

57 

0.94 

0.26 

1.19 

0.49 

BMS 

19 

50593 

2 

0 

7 

13 

-0.64 

0.30 

0.54 

-0.27 

BMS 

19 

50593 

3 

0 

6 

11 

-0.67 

0.20 

0.49 

-0.25 

BMS 

19 

50593 

4 

0 

10 

19 

-0.18 

0.42 

1.42 

-0.18 

BMS 

20 

5MD46 

* 

-1 

4640 

97 

0.89 

0.02 

0.00 

-0.07 

BMS 

20 

5MD46 

1 

1 

88 

73 

1.75 

0.12 

0.92 

0.43 

BMS 

20 

5MD46 

2 

0 

16 

13 

0.46 

0.16 

0.60 

-0.34 

BMS 

20 

5MD46 

3 

0 

17 

14 

0.86 

0.13 

0.87 

-0.21 

BMS 

20 

5MD46 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

21 

5MD21 

* 

-1 

4651 

98 

0.88 

0.02 

0.00 

-0.12 

BMS 

21 

5MD21 

1 

1 

79 

72 

2.24 

0.11 

0.92 

0.47 

BMS 

21 

5MD21 

2 

0 

25 

23 

1.21 

0.17 

0.81 

-0.36 

BMS 

21 

5MD21 

3 

0 

6 

5 

0.80 

0.26 

0.49 

-0.26 

BMS 

21 

5MD21 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

22 

5MD218 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.11 

BMS 

22 

5MD218 

1 

1 

64 

59 

2.22 

0.11 

0.90 

0.49 

BMS 

22 

5MD218 

2 

0 

23 

21 

1.36 

0.17 

0.88 

-0.28 

BMS 

22 

5MD218 

3 

0 

22 

20 

1.29 

0.13 

0.73 

-0.31 

BMS 

22 

5MD218 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

23 

5G26 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

BMS 

23 

5G26 

1 

1 

77 

77 

1.65 

0.12 

0.98 

0.36 

BMS 

23 

5G26 

2 

0 

15 

15 

0.78 

0.14 

0.74 

-0.28 

BMS 

23 

5G26 

3 

0 

8 

8 

0.82 

0.23 

0.80 

-0.19 

BMS 

23 

5G26 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

24 

5G223 

* 

-1 

4653 

98 

0.89 

0.02 

0.00 

-0.05 

BMS 

24 

5G223 

1 

1 

74 

69 

1.67 

0.13 

0.97 

0.42 

BMS 

24 

5G223 

2 

0 

24 

22 

0.72 

0.13 

0.76 

-0.33 

BMS 

24 

5G223 

3 

0 

10 

9 

0.74 

0.20 

0.77 

-0.19 

BMS 

24 

5G223 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

25 

5G314 

* 

-1 

4546 

95 

0.87 

0.02 

0.00 

-0.11 

BMS 

25 

5G314 

1 

1 

134 

62 

1.92 

0.09 

0.96 

0.40 

BMS 

25 

5G314 

2 

0 

32 

15 

1.25 

0.16 

1.23 

-0.14 

BMS 

25 

5G314 

3 

0 

49 

23 

0.91 

0.11 

0.82 

-0.35 

BMS 

25 

5G314 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

26 

50661 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

BMS 

26 

50661 

1 

1 

41 

79 

0.47 

0.14 

0.95 

0.36 

BMS 

26 

50661 

2 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

26 

50661 

3 

0 

4 

8 

-0.10 

0.46 

1.16 

-0.12 

BMS 

26 

50661 

4 

0 

7 

13 

-0.53 

0.34 

0.89 

-0.34 

BMS 

27 

5G122 

* 

-1 

4650 

98 

0.89 

0.02 

0.00 

-0.06 

BMS 

27 

5G122 

1 

1 

91 

82 

1.59 

0.10 

0.93 

0.36 

BMS 

27 

5G122 

2 

0 

18 

16 

0.75 

0.18 

0.82 

-0.32 

BMS 

27 

5G122 

3 

0 

2 

2 

0.39 

0.14 

0.46 

-0.15 

BMS 

27 

5G122 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

28 

5G34 

* 

-1 

4636 

97 

0.89 

0.02 

0.00 

-0.04 

BMS 

28 

5G34 

1 

1 

95 

76 

1.39 

0.10 

1.01 

0.28 

BMS 

28 

5G34 

2 

0 

23 

18 

0.73 

0.19 

1.19 

-0.23 

BMS 

28 

5G34 

3 

0 

7 

6 

0.69 

0.27 

0.97 

-0.13 

BMS 

28 

5G34 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

29 

51029 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.02 

BMS 

29 

51029 

1 

1 

28 

50 

1.13 

0.19 

0.94 

0.48 

BMS 

29 

51029 

2 

0 

20 

36 

0.16 

0.22 

0.94 

-0.34 

BMS 

29 

51029 

3 

0 

6 

11 

-0.06 

0.22 

0.58 

-0.23 

BMS 

29 

51029 

4 

0 

2 

4 

0.42 

0.33 

0.86 

-0.04 

BMS 

30 

50A322 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

BMS 

30 

50A322 

1 

1 

59 

59 

1.84 

0.11 

0.86 

0.51 

BMS 

30 

50A322 

2 

0 

15 

15 

0.81 

0.12 

0.63 

-0.31 

BMS 

30 

50A322 

3 

0 

26 

26 

0.99 

0.13 

0.83 

-0.32 

BMS 

30 

50A322 

4 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

31 

I6NS7010 

* 

-1 

2484 

94 

0.35 

0.02 

0.00 

0.12 

BMS 

31 

I6NS7010 

A 

1 

139 

85 

0.09 

0.05 

0.93 

0.41 

BMS 

31 

I6NS7010 

B 

0 

20 

12 

-0.66 

0.11 

0.69 

-0.36 

BMS 

31 

I6NS7010 

C 

0 

4 

2 

-0.76 

0.23 

0.60 

-0.18 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

32 

I6RP2047 

* 

-1 

2483 

94 

0.35 

0.02 

0.00 

0.13 

BMS 

32 

I6RP2047 

A 

1 

94 

57 

0.14 

0.07 

0.96 

0.33 

BMS 

32 

I6RP2047 

B 

0 

63 

38 

-0.28 

0.08 

0.99 

-0.27 

BMS 

32 

I6RP2047 

C 

0 

7 

4 

-0.58 

0.29 

0.75 

-0.16 

BMS 

33 

I6NS1019 

* 

-1 

6636 

75 

0.05 

0.01 

0.00 

0.13 

BMS 

33 

I6NS1019 

A 

1 

995 

45 

0.09 

0.02 

0.99 

0.33 

BMS 

33 

I6NS1019 

B 

0 

248 

11 

-0.49 

0.03 

0.85 

-0.17 

BMS 

33 

I6NS1019 

C 

0 

952 

43 

-0.34 

0.02 

0.99 

-0.23 

BMS 

34 

I6RP3028 

* 

-1 

2479 

94 

0.35 

0.02 

0.00 

0.12 

BMS 

34 

I6RP3028 

A 

1 

79 

47 

0.28 

0.08 

0.96 

0.43 

BMS 

34 

I6RP3028 

B 

0 

77 

46 

-0.23 

0.05 

0.89 

-0.30 

BMS 

34 

I6RP3028 

C 

0 

12 

7 

-0.60 

0.14 

0.61 

-0.25 

BMS 

35 

I6EE9005 

* 

-1 

2486 

94 

0.34 

0.02 

0.00 

0.09 

BMS 

35 

I6EE9005 

A 

1 

44 

27 

0.43 

0.12 

1.03 

0.31 

BMS 

35 

I6EE9005 

B 

0 

77 

48 

-0.05 

0.08 

1.06 

-0.15 

BMS 

35 

I6EE9005 

C 

0 

40 

25 

-0.11 

0.10 

0.91 

-0.14 

BMS 

36 

40592 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

36 

40592 

A 

1 

40 

82 

1.38 

0.18 

0.84 

0.53 

BMS 

36 

40592 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

36 

40592 

C 

0 

4 

8 

0.85 

0.24 

1.25 

-0.03 

BMS 

36 

40592 

D 

0 

5 

10 

-1.92 

0.83 

0.18 

-0.65 

BMS 

37 

40A37 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

BMS 

37 

40A37 

A 

1 

98 

82 

1.46 

0.09 

1.00 

0.38 

BMS 

37 

40A37 

B 

0 

12 

10 

0.72 

0.18 

0.83 

-0.22 

BMS 

37 

40A37 

C 

0 

10 

8 

0.48 

0.19 

0.63 

-0.29 

BMS 

37 

40A37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Test Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

38 

4G232 

* 

-1 

4675 

96 

0.99 

0.02 

0.00 

-0.04 

BMS 

38 

4G232 

A 

1 

141 

67 

1.52 

0.07 

0.90 

0.44 

BMS 

38 

4G232 

B 

0 

52 

25 

0.81 

0.10 

0.95 

-0.30 

BMS 

38 

4G232 

C 

0 

16 

8 

0.42 

0.20 

0.66 

-0.28 

BMS 

38 

4G232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

39 

40A418 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

BMS 

39 

40A418 

A 

1 

65 

62 

1.94 

0.15 

1.14 

0.30 

BMS 

39 

40A418 

B 

0 

20 

19 

1.12 

0.16 

0.92 

-0.25 

BMS 

39 

40A418 

C 

0 

20 

19 

1.42 

0.16 

1.23 

-0.12 

BMS 

39 

40A418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

40 

40A54 

* 

-1 

4660 

95 

0.97 

0.02 

0.00 

-0.11 

BMS 

40 

40A54 

A 

1 

116 

52 

2.14 

0.11 

1.09 

0.42 

BMS 

40 

40A54 

B 

0 

49 

22 

1.29 

0.12 

1.10 

-0.17 

BMS 

40 

40A54 

C 

0 

59 

26 

1.02 

0.12 

0.83 

-0.32 

BMS 

40 

40A54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix D: Item Statistics 


Appendix D: Item Statistics for Full CCSS Item Bank 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50001 

0.39 

52 

23 

0.31 

1.24 

1.89 

1.31 

1.33 

-0.01 

0.26 

0.33 

50002 

-0.20 

56 

37 

0.32 

0.98 

-0.13 

0.98 

-0.01 

-0.01 

0.44 

1.03 

50003 

0.01 

62 

40 

0.31 

1.19 

1.30 

1.15 

0.67 

-0.01 

0.39 

0.69 

50004 

0.20 

52 

25 

0.30 

1.03 

0.32 

0.98 

-0.07 

-0.01 

0.39 

0.93 

50005 

0.30 

2825 

1519 

0.04 

1.15 

8.78 

1.24 

7.66 

-0.01 

0.35 

0.57 

50006 

-1.79 

60 

52 

0.42 

1.20 

0.85 

0.86 

0.01 

-0.01 

0.32 

0.87 

50007 

-3.06 

49 

46 

0.61 

0.88 

-0.10 

0.41 

-0.52 

-0.01 

0.32 

1.11 

50008 

-2.15 

59 

53 

0.47 

0.89 

-0.30 

1.17 

0.47 

-0.01 

0.38 

1.06 

50009 

-1.70 

63 

55 

0.41 

1.14 

0.61 

0.94 

0.09 

-0.01 

0.27 

0.91 

50010 

-1.32 

68 

58 

0.37 

1.21 

0.96 

2.69 

2.61 

-0.01 

0.10 

0.67 

50011 

-0.88 

59 

45 

0.35 

0.73 

-1.56 

0.54 

-1.10 

-0.01 

0.61 

1.37 

50012 

-1.69 

58 

50 

0.41 

0.93 

-0.19 

0.69 

-0.35 

-0.01 

0.37 

1.08 

50013 

-0.03 

2813 

1689 

0.04 

0.93 

-4.33 

0.89 

-3.69 

-0.01 

0.50 

1.19 

50014 

-0.50 

58 

39 

0.32 

0.97 

-0.17 

0.93 

-0.15 

-0.01 

0.46 

1.06 

50015 

-0.82 

56 

41 

0.32 

1.03 

0.25 

0.90 

-0.27 

-0.01 

0.34 

0.99 

50016 

-0.25 

53 

36 

0.34 

0.92 

-0.45 

0.84 

-0.45 

-0.01 

0.55 

1.14 

50017 

-1.25 

55 

45 

0.39 

0.83 

-0.80 

0.68 

-0.51 

-0.01 

0.50 

1.21 

50018 

-0.64 

52 

37 

0.35 

0.88 

-0.74 

0.91 

-0.15 

-0.01 

0.49 

1.17 

50019 

-0.28 

48 

32 

0.34 

0.76 

-1.89 

0.64 

-1.58 

-0.01 

0.58 

1.59 

50020 

-1.04 

49 

35 

0.35 

0.93 

-0.42 

0.85 

-0.34 

-0.01 

0.45 

1.14 

50021 

1.24 

63 

26 

0.30 

0.83 

-1.26 

0.77 

-1.13 

-0.01 

0.64 

1.32 

50022 

0.72 

59 

31 

0.30 

0.88 

-1.10 

1.00 

0.05 

-0.01 

0.53 

1.26 

50023 

0.60 

57 

30 

0.31 

0.83 

-1.29 

0.74 

-1.26 

-0.01 

0.63 

1.38 

50024 

1.27 

64 

27 

0.31 

1.01 

0.10 

0.99 

0.03 

-0.01 

0.56 

0.99 

50025 

-0.24 

64 

43 

0.31 

0.92 

-0.57 

0.76 

-0.74 

-0.01 

0.55 

1.18 

50026 

-0.13 

55 

34 

0.33 

0.92 

-0.60 

0.75 

-0.74 

-0.01 

0.57 

1.22 

50027 

-0.14 

57 

35 

0.30 

0.94 

-0.44 

0.95 

-0.19 

-0.01 

0.47 

1.13 

50028 

0.20 

49 

26 

0.31 

1.08 

0.84 

1.05 

0.35 

-0.01 

0.31 

0.70 

50029 

-1.11 

46 

34 

0.37 

0.70 

-1.74 

0.54 

-1.49 

-0.01 

0.66 

1.46 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50030 

- 0.81 

59 

44 

0.33 

1.07 

0.54 

1.23 

0.70 

- 0.01 

0.29 

0.81 

50031 

- 1.53 

63 

55 

0.41 

0.84 

- 0.59 

0.45 

- 0.89 

- 0.01 

0.45 

1.20 

50032 

- 0.92 

72 

58 

0.33 

0.84 

- 0.92 

0.84 

- 0.26 

- 0.01 

0.47 

1.16 

50033 

- 0.29 

50 

31 

0.34 

0.71 

- 1.95 

0.61 

- 1.72 

- 0.01 

0.68 

1.53 

50034 

- 0.59 

69 

51 

0.31 

0.87 

- 0.82 

0.66 

- 0.97 

- 0.01 

0.54 

1.24 

50035 

- 0.48 

62 

42 

0.32 

0.77 

- 1.63 

0.61 

- 1.24 

- 0.01 

0.63 

1.40 

50036 

0.52 

50 

23 

0.33 

0.85 

- 1.16 

1.06 

0.38 

- 0.01 

0.56 

1.29 

50037 

- 1.90 

62 

54 

0.41 

0.86 

- 0.52 

0.48 

- 0.82 

- 0.01 

0.44 

1.19 

50038 

- 1.43 

58 

49 

0.38 

0.99 

0.05 

0.78 

- 0.30 

- 0.01 

0.32 

1.04 

50039 

- 1.80 

53 

44 

0.40 

0.98 

0.00 

0.91 

0.03 

- 0.01 

0.36 

1.01 

50040 

- 0.94 

55 

41 

0.35 

0.77 

- 1.39 

0.74 

- 0.60 

- 0.01 

0.55 

1.32 

50041 

2.10 

52 

11 

0.38 

0.91 

- 0.35 

0.66 

- 0.81 

- 0.01 

0.52 

1.15 

50042 

1.03 

64 

28 

0.29 

1.13 

1.08 

1.10 

0.59 

- 0.01 

0.37 

0.71 

50043 

2.00 

49 

13 

0.40 

1.20 

0.93 

1.74 

1.71 

- 0.01 

0.42 

0.68 

50044 

1.36 

49 

19 

0.36 

0.89 

- 0.58 

0.76 

- 0.71 

- 0.01 

0.64 

1.19 

50045 

- 0.27 

55 

36 

0.33 

1.07 

0.51 

1.06 

0.33 

- 0.01 

0.42 

0.87 

50046 

0.43 

50 

25 

0.33 

0.95 

- 0.34 

0.92 

- 0.35 

- 0.01 

0.52 

1.13 

50047 

- 0.49 

49 

33 

0.34 

0.85 

- 1.00 

0.78 

- 0.66 

- 0.01 

0.52 

1.31 

50048 

- 0.96 

59 

46 

0.35 

0.69 

- 1.88 

0.50 

- 1.32 

- 0.01 

0.60 

1.43 

50049 

- 1.09 

48 

36 

0.37 

0.78 

- 1.29 

1.32 

0.93 

- 0.01 

0.50 

1.24 

50050 

0.26 

55 

30 

0.30 

1.04 

0.38 

1.31 

1.52 

- 0.01 

0.39 

0.76 

50051 

0.73 

50 

22 

0.34 

0.91 

- 0.59 

0.83 

- 0.67 

- 0.01 

0.58 

1.21 

50052 

1.24 

55 

18 

0.33 

1.02 

0.21 

1.22 

0.84 

- 0.01 

0.43 

0.91 

50053 

0.45 

61 

35 

0.30 

0.99 

- 0.08 

0.85 

- 0.68 

- 0.01 

0.53 

1.10 

50054 

1.86 

60 

15 

0.32 

0.76 

- 1.52 

0.64 

- 1.46 

- 0.01 

0.61 

1.36 

50055 

2.54 

52 

10 

0.41 

0.88 

- 0.46 

0.75 

- 0.38 

- 0.01 

0.55 

1.13 

50056 

1.30 

56 

22 

0.32 

0.88 

- 0.84 

1.66 

2.24 

- 0.01 

0.52 

1.03 

50057 

1.84 

49 

16 

0.37 

0.86 

- 0.73 

0.83 

- 0.37 

- 0.01 

0.62 

1.19 

50058 

1.37 

61 

22 

0.30 

0.77 

- 1.82 

0.74 

- 1.25 

- 0.01 

0.62 

1.44 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50059 

1.65 

57 

15 

0.33 

1.03 

0.24 

0.96 

- 0.05 

- 0.01 

0.40 

0.97 

50060 

1.44 

57 

16 

0.34 

1.40 

2.05 

1.62 

1.77 

- 0.01 

0.17 

0.41 

50061 

- 0.70 

55 

39 

0.35 

0.98 

- 0.06 

0.80 

- 0.49 

- 0.01 

0.51 

1.08 

50062 

- 2.59 

56 

53 

0.63 

1.17 

0.50 

0.91 

0.23 

- 0.01 

0.18 

0.93 

50063 

- 1.01 

50 

40 

0.39 

1.19 

0.86 

2.45 

2.47 

- 0.01 

0.21 

0.65 

50064 

- 1.42 

59 

49 

0.38 

1.22 

1.06 

1.32 

0.71 

- 0.01 

0.24 

0.73 

50065 

- 2.21 

60 

54 

0.45 

0.77 

- 0.69 

0.39 

- 1.06 

- 0.01 

0.46 

1.21 

50066 

- 2.22 

56 

51 

0.50 

0.97 

0.05 

1.35 

0.67 

- 0.01 

0.30 

1.00 

50067 

- 2.94 

61 

57 

0.55 

1.16 

0.51 

0.69 

- 0.03 

- 0.01 

0.24 

0.95 

50068 

- 0.97 

56 

43 

0.35 

1.00 

0.08 

0.91 

- 0.11 

- 0.01 

0.42 

1.02 

50069 

- 1.90 

60 

55 

0.49 

0.87 

- 0.25 

0.54 

- 0.53 

- 0.01 

0.36 

1.11 

50070 

- 2.07 

53 

46 

0.44 

0.99 

0.06 

1.11 

0.38 

- 0.01 

0.35 

0.98 

50071 

- 1.90 

60 

54 

0.45 

1.06 

0.28 

0.91 

0.08 

- 0.01 

0.22 

0.97 

50072 

- 2.28 

58 

54 

0.54 

1.02 

0.17 

0.73 

- 0.11 

- 0.01 

0.25 

1.01 

50073 

- 1.80 

52 

46 

0.46 

1.06 

0.30 

1.09 

0.36 

- 0.01 

0.26 

0.94 

50074 

0.09 

57 

35 

0.31 

1.01 

0.16 

1.01 

0.12 

- 0.01 

0.44 

0.95 

50075 

- 2.15 

50 

44 

0.47 

0.87 

- 0.32 

0.69 

- 0.41 

- 0.01 

0.44 

1.11 

50076 

- 1.08 

51 

40 

0.37 

1.03 

0.22 

1.18 

0.53 

- 0.01 

0.32 

0.92 

50077 

- 0.69 

56 

41 

0.35 

1.02 

0.16 

0.73 

- 0.65 

- 0.01 

0.50 

1.06 

50078 

0.15 

2800 

1586 

0.04 

0.94 

- 3.34 

0.91 

- 3.03 

- 0.01 

0.50 

1.15 

50079 

0.02 

63 

38 

0.28 

0.95 

- 0.46 

0.92 

- 0.34 

- 0.01 

0.44 

1.15 

50080 

- 0.45 

51 

36 

0.33 

1.09 

0.59 

0.99 

0.03 

- 0.01 

0.31 

0.89 

50081 

- 0.91 

50 

37 

0.35 

0.97 

- 0.10 

0.91 

- 0.24 

- 0.01 

0.41 

1.06 

50082 

- 0.48 

51 

38 

0.36 

1.11 

0.67 

1.44 

1.06 

- 0.01 

0.33 

0.75 

50083 

1.94 

61 

18 

0.33 

1.24 

1.37 

3.05 

4.26 

- 0.01 

0.26 

0.45 

50084 

0.77 

51 

21 

0.32 

1.17 

1.37 

1.15 

0.62 

- 0.01 

0.32 

0.56 

50085 

- 1.15 

57 

44 

0.35 

1.13 

0.76 

1.27 

0.74 

- 0.01 

0.29 

0.79 

50086 

- 1.75 

55 

47 

0.40 

0.85 

- 0.57 

0.58 

- 0.84 

- 0.01 

0.40 

1.19 

50087 

- 0.06 

54 

32 

0.32 

1.25 

1.83 

2.16 

3.63 

- 0.01 

0.25 

0.19 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50088 

0.04 

50 

31 

0.33 

0.80 

- 1.55 

0.72 

- 1.24 

- 0.01 

0.59 

1.47 

50089 

- 2.47 

57 

52 

0.51 

0.90 

- 0.19 

0.71 

- 0.14 

- 0.01 

0.37 

1.09 

50090 

- 2.18 

52 

46 

0.47 

0.73 

- 0.81 

0.54 

- 0.79 

- 0.01 

0.52 

1.20 

50091 

- 1.63 

56 

47 

0.41 

0.77 

- 0.93 

0.47 

- 0.84 

- 0.01 

0.55 

1.25 

50092 

2.04 

50 

11 

0.39 

1.09 

0.48 

1.26 

0.69 

- 0.01 

0.37 

0.84 

50093 

2.21 

57 

13 

0.38 

1.05 

0.29 

1.62 

1.41 

- 0.01 

0.44 

0.86 

50094 

- 2.28 

53 

48 

0.49 

0.91 

- 0.15 

1.09 

0.38 

- 0.01 

0.28 

1.02 

50095 

- 1.85 

57 

48 

0.41 

1.18 

0.84 

5.42 

3.52 

- 0.01 

0.17 

0.53 

50096 

- 1.14 

50 

40 

0.38 

1.13 

0.66 

1.30 

0.73 

- 0.01 

0.22 

0.82 

50097 

- 1.57 

59 

50 

0.40 

0.94 

- 0.15 

0.77 

- 0.35 

- 0.01 

0.42 

1.07 

50098 

- 2.30 

53 

49 

0.55 

1.22 

0.65 

1.00 

0.33 

- 0.01 

0.17 

0.86 

50099 

- 1.69 

52 

45 

0.46 

0.97 

- 0.01 

0.64 

- 0.38 

- 0.01 

0.43 

1.07 

50100 

2.51 

51 

7 

0.45 

0.80 

- 0.67 

1.68 

1.19 

- 0.01 

0.46 

1.10 

50101 

- 3.42 

48 

46 

0.74 

1.05 

0.28 

0.87 

0.26 

- 0.01 

0.16 

0.97 

50102 

- 2.59 

49 

46 

0.61 

1.06 

0.29 

0.98 

0.26 

- 0.01 

0.16 

0.97 

50103 

- 1.62 

62 

54 

0.41 

1.09 

0.44 

1.24 

0.58 

- 0.01 

0.26 

0.89 

50104 

- 3.22 

53 

51 

0.73 

0.93 

0.10 

0.40 

- 0.42 

- 0.01 

0.27 

1.07 

50105 

- 4.00 

49 

48 

1.01 

1.03 

0.35 

2.04 

1.07 

- 0.01 

- 0.08 

0.93 

50106 

- 1.84 

50 

43 

0.43 

1.29 

1.06 

1.48 

1.03 

- 0.01 

- 0.02 

0.69 

50107 

- 1.84 

52 

43 

0.40 

0.88 

- 0.40 

1.35 

0.85 

- 0.01 

0.38 

1.02 

50108 

- 1.10 

48 

38 

0.39 

0.90 

- 0.48 

0.70 

- 0.59 

- 0.01 

0.42 

1.18 

50109 

- 0.33 

52 

33 

0.33 

0.90 

- 0.63 

0.87 

- 0.33 

- 0.01 

0.55 

1.18 

50110 

0.61 

51 

22 

0.31 

1.18 

1.50 

1.33 

1.79 

- 0.01 

0.23 

0.39 

50111 

0.24 

52 

28 

0.32 

1.07 

0.58 

1.15 

0.78 

- 0.01 

0.41 

0.78 

50112 

- 0.73 

268 

214 

0.16 

0.98 

- 0.17 

1.01 

0.10 

0.00 

0.32 

1.01 

50113 

- 0.96 

51 

36 

0.34 

0.99 

- 0.04 

0.91 

- 0.19 

- 0.01 

0.42 

1.05 

50114 

- 0.66 

58 

43 

0.33 

0.94 

- 0.34 

0.83 

- 0.52 

- 0.01 

0.46 

1.11 

50115 

- 2.02 

309 

293 

0.27 

0.93 

- 0.24 

0.59 

- 1.18 

0.00 

0.28 

1.06 

50116 

- 2.15 

52 

46 

0.45 

0.84 

- 0.43 

0.55 

- 0.71 

- 0.01 

0.41 

1.16 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50117 

- 2.49 

58 

55 

0.60 

0.97 

0.11 

0.55 

- 0.38 

- 0.01 

0.25 

1.05 

50118 

- 2.44 

49 

45 

0.54 

0.79 

- 0.42 

0.42 

- 0.79 

- 0.01 

0.40 

1.17 

50119 

- 1.41 

59 

49 

0.38 

0.82 

- 0.78 

0.53 

- 1.08 

- 0.01 

0.53 

1.23 

50120 

- 2.88 

50 

47 

0.62 

0.91 

- 0.02 

0.50 

- 0.43 

- 0.01 

0.32 

1.08 

50121 

- 1.36 

54 

43 

0.36 

0.81 

- 0.96 

0.79 

- 0.56 

- 0.01 

0.48 

1.23 

50122 

- 2.60 

48 

45 

0.62 

1.20 

0.56 

1.41 

0.70 

- 0.01 

0.04 

0.85 

50123 

- 0.83 

63 

49 

0.33 

1.00 

0.08 

1.03 

0.19 

- 0.01 

0.38 

0.99 

50124 

- 2.39 

49 

43 

0.48 

0.92 

- 0.17 

0.61 

- 0.29 

- 0.01 

0.39 

1.10 

50125 

- 1.70 

50 

42 

0.42 

0.86 

- 0.47 

0.67 

- 0.42 

- 0.01 

0.46 

1.15 

50126 

- 1.17 

288 

262 

0.22 

1.04 

0.32 

1.00 

0.10 

0.00 

0.29 

0.98 

50127 

- 1.98 

51 

42 

0.39 

0.80 

- 0.87 

0.64 

- 0.69 

- 0.01 

0.48 

1.23 

50128 

- 0.67 

50 

33 

0.33 

0.89 

- 0.81 

0.88 

- 0.40 

- 0.01 

0.46 

1.24 

50129 

- 1.94 

51 

45 

0.45 

1.11 

0.45 

1.50 

0.97 

- 0.01 

0.05 

0.85 

50130 

- 0.41 

49 

32 

0.33 

1.10 

0.72 

1.04 

0.28 

- 0.01 

0.33 

0.82 

50131 

0.01 

269 

210 

0.16 

0.89 

- 1.29 

0.79 

- 1.37 

0.00 

0.49 

1.15 

50132 

0.71 

50 

20 

0.34 

1.25 

1.58 

1.45 

1.81 

- 0.01 

0.33 

0.45 

50133 

0.57 

50 

25 

0.33 

0.91 

- 0.63 

0.86 

- 0.59 

- 0.01 

0.56 

1.21 

50134 

- 0.44 

59 

42 

0.32 

1.31 

1.93 

1.35 

1.19 

- 0.01 

0.20 

0.45 

50135 

0.00 

55 

30 

0.30 

1.20 

1.92 

1.23 

1.42 

- 0.01 

0.23 

0.29 

50136 

1.69 

50 

10 

0.39 

1.00 

0.07 

1.14 

0.47 

- 0.01 

0.39 

0.96 

50137 

- 0.21 

50 

29 

0.32 

1.03 

0.29 

0.93 

- 0.20 

- 0.01 

0.42 

0.97 

50138 

- 1.48 

57 

48 

0.40 

1.08 

0.41 

1.15 

0.44 

- 0.01 

0.32 

0.92 

50139 

0.21 

50 

27 

0.32 

0.89 

- 0.88 

0.85 

- 0.72 

- 0.01 

0.54 

1.29 

50140 

0.01 

53 

31 

0.31 

0.97 

- 0.19 

0.94 

- 0.23 

- 0.01 

0.46 

1.08 

50141 

3.07 

48 

4 

0.54 

1.17 

0.53 

1.85 

1.24 

- 0.01 

- 0.06 

0.82 

50142 

0.45 

50 

21 

0.31 

1.08 

0.74 

1.32 

1.78 

- 0.01 

0.28 

0.62 

50143 

0.65 

64 

32 

0.29 

1.05 

0.46 

1.03 

0.19 

- 0.01 

0.45 

0.89 

50144 

2.16 

48 

12 

0.37 

1.13 

0.73 

1.03 

0.20 

- 0.01 

0.34 

0.84 

50145 

- 0.82 

51 

35 

0.33 

0.89 

- 0.77 

0.78 

- 0.64 

- 0.01 

0.50 

1.25 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50146 

- 1.44 

58 

49 

0.39 

1.00 

0.09 

2.84 

2.69 

- 0.01 

0.19 

0.83 

50147 

0.79 

46 

19 

0.34 

0.89 

- 0.77 

0.84 

- 0.79 

- 0.01 

0.54 

1.28 

50148 

1.43 

56 

21 

0.32 

0.96 

- 0.21 

1.05 

0.28 

- 0.01 

0.46 

1.03 

50149 

- 1.60 

49 

40 

0.40 

0.83 

- 0.73 

0.68 

- 0.60 

- 0.01 

0.48 

1.20 

50150 

1.43 

52 

18 

0.33 

1.24 

1.57 

1.92 

2.93 

- 0.01 

0.23 

0.33 

50151 

- 2.40 

51 

47 

0.59 

0.85 

- 0.22 

0.40 

- 0.44 

- 0.01 

0.47 

1.13 

50152 

- 0.79 

53 

40 

0.36 

0.85 

- 0.76 

0.66 

- 0.90 

- 0.01 

0.55 

1.24 

50153 

- 1.67 

48 

42 

0.46 

0.77 

- 0.76 

0.46 

- 0.90 

- 0.01 

0.46 

1.25 

50154 

- 2.73 

54 

51 

0.62 

0.77 

- 0.33 

0.45 

- 0.50 

- 0.01 

0.40 

1.13 

50155 

- 1.26 

52 

42 

0.39 

0.85 

- 0.65 

0.63 

- 0.81 

- 0.01 

0.51 

1.20 

50156 

- 1.92 

53 

47 

0.48 

0.78 

- 0.66 

0.46 

- 0.67 

- 0.01 

0.50 

1.20 

50157 

- 0.88 

51 

39 

0.36 

0.93 

- 0.32 

0.72 

- 0.73 

- 0.01 

0.48 

1.15 

50158 

- 1.65 

49 

43 

0.46 

1.02 

0.18 

1.11 

0.38 

- 0.01 

0.24 

0.96 

50159 

- 0.90 

59 

46 

0.34 

0.94 

- 0.29 

0.82 

- 0.34 

- 0.01 

0.41 

1.10 

50160 

- 0.57 

53 

37 

0.34 

0.99 

0.01 

1.01 

0.12 

- 0.01 

0.43 

1.01 

50161 

- 1.00 

53 

40 

0.37 

0.83 

- 0.89 

0.88 

- 0.21 

- 0.01 

0.54 

1.19 

50162 

- 0.60 

51 

38 

0.36 

1.13 

0.79 

1.87 

2.11 

- 0.01 

0.27 

0.62 

50163 

- 1.03 

52 

41 

0.38 

1.19 

1.02 

2.31 

2.16 

- 0.01 

0.21 

0.56 

50164 

- 0.69 

51 

39 

0.36 

0.97 

- 0.11 

0.84 

- 0.34 

- 0.01 

0.39 

1.07 

50165 

- 0.84 

53 

38 

0.35 

1.00 

0.05 

1.34 

0.85 

- 0.01 

0.43 

0.90 

50166 

- 0.95 

53 

42 

0.36 

1.04 

0.24 

0.94 

- 0.08 

- 0.01 

0.30 

0.98 

50167 

- 1.32 

51 

42 

0.42 

0.86 

- 0.51 

0.73 

- 0.46 

- 0.01 

0.49 

1.15 

50168 

- 1.05 

53 

40 

0.36 

0.88 

- 0.58 

0.76 

- 0.62 

- 0.01 

0.53 

1.17 

50169 

- 1.70 

54 

47 

0.43 

0.89 

- 0.31 

0.83 

- 0.17 

- 0.01 

0.36 

1.09 

50170 

- 1.43 

51 

41 

0.39 

1.02 

0.19 

0.88 

- 0.12 

- 0.01 

0.36 

0.99 

50171 

- 0.81 

50 

35 

0.35 

0.93 

- 0.45 

0.93 

- 0.04 

- 0.01 

0.46 

1.12 

50172 

1.01 

48 

20 

0.33 

1.02 

0.17 

1.42 

1.26 

- 0.01 

0.41 

0.82 

50173 

0.76 

52 

23 

0.32 

0.99 

- 0.02 

0.96 

- 0.15 

- 0.01 

0.48 

1.04 

50174 

0.67 

269 

175 

0.14 

0.98 

- 0.37 

0.97 

- 0.25 

0.00 

0.45 

1.05 



easyCBM CCSS Fifth Grade Math Measure Development 


170 

Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50175 

0.82 

52 

21 

0.32 

0.95 

- 0.30 

0.99 

0.02 

- 0.01 

0.49 

1.08 

50176 

- 0.03 

54 

30 

0.30 

0.98 

- 0.16 

0.99 

0.02 

- 0.01 

0.43 

1.05 

50177 

- 0.08 

50 

34 

0.35 

0.92 

- 0.49 

0.84 

- 0.49 

- 0.01 

0.53 

1.16 

50178 

0.53 

48 

24 

0.35 

0.87 

- 0.93 

0.73 

- 0.80 

- 0.01 

0.61 

1.33 

50179 

- 0.03 

54 

34 

0.32 

0.79 

- 1.61 

0.69 

- 1.42 

- 0.01 

0.61 

1.47 

50180 

1.55 

53 

19 

0.33 

0.79 

- 1.42 

0.67 

- 1.61 

- 0.01 

0.65 

1.42 

50181 

- 0.41 

57 

39 

0.31 

1.00 

0.06 

0.90 

- 0.26 

- 0.01 

0.41 

1.03 

50182 

0.55 

57 

30 

0.32 

0.81 

- 1.60 

0.89 

- 0.31 

- 0.01 

0.61 

1.42 

50183 

- 0.03 

56 

33 

0.30 

0.75 

- 2.28 

0.66 

- 1.71 

- 0.01 

0.61 

1.70 

50184 

1.02 

53 

19 

0.33 

0.75 

- 1.78 

0.71 

- 0.69 

- 0.01 

0.61 

1.47 

50185 

- 0.94 

53 

39 

0.36 

0.81 

- 1.05 

0.63 

- 0.99 

- 0.01 

0.58 

1.30 

50186 

0.60 

52 

28 

0.34 

1.01 

0.14 

1.25 

0.81 

- 0.01 

0.53 

0.90 

50187 

- 0.39 

57 

39 

0.31 

0.99 

- 0.04 

0.93 

- 0.23 

- 0.01 

0.39 

1.04 

50188 

0.55 

49 

23 

0.32 

1.29 

2.37 

1.39 

1.68 

- 0.01 

0.22 

0.04 

50189 

- 0.02 

51 

31 

0.31 

0.89 

- 0.95 

0.79 

- 1.24 

- 0.01 

0.53 

1.36 

50190 

- 0.06 

49 

25 

0.32 

0.82 

- 1.67 

0.79 

- 0.74 

- 0.01 

0.56 

1.55 

50191 

- 1.09 

52 

39 

0.34 

0.99 

- 0.03 

0.90 

- 0.23 

- 0.01 

0.36 

1.05 

50192 

- 1.24 

58 

48 

0.38 

0.99 

0.02 

0.89 

- 0.08 

- 0.01 

0.36 

1.02 

50193 

- 0.15 

48 

32 

0.33 

1.13 

0.95 

1.62 

2.21 

- 0.01 

0.25 

0.62 

50194 

- 1.48 

53 

42 

0.37 

0.95 

- 0.18 

0.71 

- 0.73 

- 0.01 

0.46 

1.12 

50195 

- 0.46 

52 

33 

0.33 

1.00 

0.02 

0.98 

0.00 

- 0.01 

0.46 

1.01 

50196 

- 1.80 

53 

43 

0.39 

0.93 

- 0.27 

0.79 

- 0.35 

- 0.01 

0.44 

1.09 

50197 

- 0.74 

49 

35 

0.35 

1.00 

0.06 

0.79 

- 0.56 

- 0.01 

0.45 

1.07 

50198 

- 2.49 

53 

49 

0.55 

1.06 

0.27 

0.61 

- 0.26 

- 0.01 

0.27 

1.02 

50199 

- 0.28 

54 

35 

0.32 

0.89 

- 0.84 

0.81 

- 0.64 

- 0.01 

0.50 

1.28 

50200 

- 1.64 

50 

43 

0.43 

0.68 

- 1.20 

0.42 

- 1.29 

- 0.01 

0.60 

1.31 

50201 

1.80 

58 

14 

0.33 

1.03 

0.22 

1.18 

0.74 

- 0.01 

0.30 

0.93 

50202 

2.28 

50 

11 

0.39 

0.94 

- 0.22 

1.00 

0.16 

0.00 

0.47 

1.04 

50203 

0.60 

62 

30 

0.29 

1.10 

0.95 

1.18 

0.99 

- 0.01 

0.37 

0.68 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50204 

0.68 

259 

160 

0.14 

0.84 

-3.15 

0.74 

-3.07 

0.00 

0.55 

1.47 

50205 

2.18 

56 

12 

0.38 

0.96 

-0.12 

0.95 

0.01 

-0.01 

0.50 

1.04 

50206 

1.32 

54 

22 

0.33 

0.85 

-0.98 

0.73 

-1.19 

-0.01 

0.62 

1.30 

50207 

1.08 

287 

170 

0.13 

0.85 

-3.12 

0.77 

-2.46 

0.00 

0.56 

1.42 

50208 

0.58 

56 

27 

0.29 

0.95 

-0.46 

0.90 

-0.57 

-0.01 

0.46 

1.19 

50209 

1.47 

56 

20 

0.33 

1.16 

0.98 

2.28 

3.49 

-0.01 

0.38 

0.58 

50210 

1.73 

48 

12 

0.37 

1.34 

1.64 

1.84 

2.08 

-0.01 

0.13 

0.39 

50211 

-2.44 

54 

49 

0.53 

0.94 

-0.03 

0.91 

0.14 

-0.01 

0.38 

1.01 

50212 

-2.73 

51 

48 

0.62 

1.03 

0.22 

2.41 

1.48 

-0.01 

0.09 

0.90 

50213 

-4.18 

54 

53 

1.02 

1.05 

0.36 

0.79 

0.31 

-0.01 

0.10 

0.97 

50214 

-1.51 

57 

48 

0.39 

1.08 

0.41 

0.96 

0.05 

-0.01 

0.28 

0.95 

50215 

-2.52 

52 

48 

0.56 

0.96 

0.05 

0.76 

0.00 

-0.01 

0.29 

1.02 

50216 

-2.29 

267 

257 

0.34 

0.98 

0.01 

0.74 

-0.39 

0.00 

0.29 

1.02 

50217 

-1.93 

56 

48 

0.43 

0.64 

-1.48 

0.38 

-1.07 

-0.01 

0.56 

1.34 

50218 

-1.84 

63 

57 

0.45 

1.04 

0.23 

0.81 

-0.19 

-0.01 

0.25 

0.99 

50219 

-0.35 

60 

40 

0.32 

1.01 

0.10 

0.91 

-0.30 

-0.01 

0.48 

1.02 

50220 

-2.22 

61 

55 

0.47 

0.78 

-0.63 

0.52 

-0.67 

-0.01 

0.45 

1.17 

50221 

-0.95 

50 

38 

0.36 

1.20 

1.03 

1.54 

1.55 

-0.01 

0.15 

0.65 

50222 

-0.13 

55 

33 

0.31 

0.89 

-0.87 

0.79 

-1.10 

-0.01 

0.54 

1.32 

50223 

-0.99 

51 

40 

0.38 

1.08 

0.43 

1.15 

0.49 

-0.01 

0.34 

0.87 

50224 

-3.01 

52 

48 

0.68 

0.50 

-1.01 

0.14 

-0.93 

-0.01 

0.67 

1.28 

50225 

-0.54 

61 

42 

0.31 

0.88 

-0.91 

0.78 

-0.89 

-0.01 

0.49 

1.28 

50226 

-1.28 

268 

241 

0.22 

0.88 

-0.79 

0.69 

-0.98 

0.00 

0.43 

1.11 

50227 

-1.25 

55 

43 

0.38 

1.13 

0.66 

1.30 

0.75 

-0.01 

0.37 

0.81 

50228 

-1.16 

50 

40 

0.38 

0.90 

-0.41 

0.81 

-0.48 

-0.01 

0.45 

1.13 

50229 

-0.43 

48 

31 

0.34 

0.78 

-1.53 

0.87 

-0.55 

-0.01 

0.57 

1.39 

50230 

-1.19 

50 

41 

0.39 

1.07 

0.36 

1.30 

0.85 

-0.01 

0.24 

0.90 

50231 

-1.51 

48 

40 

0.43 

0.94 

-0.13 

0.81 

-0.27 

-0.01 

0.40 

1.07 

50232 

-0.46 

51 

37 

0.35 

0.83 

-1.06 

0.83 

-0.41 

-0.01 

0.52 

1.26 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50233 

2.30 

50 

10 

0.39 

1.12 

0.60 

1.56 

1.46 

- 0.01 

0.23 

0.81 

50234 

0.35 

255 

183 

0.16 

0.91 

- 1.23 

0.75 

- 1.48 

0.00 

0.53 

1.18 

50235 

- 2.11 

48 

42 

0.48 

1.04 

0.24 

0.70 

- 0.23 

- 0.01 

0.35 

1.02 

50236 

- 1.77 

55 

46 

0.41 

0.90 

- 0.30 

1.01 

0.21 

- 0.01 

0.45 

1.05 

50237 

- 0.65 

49 

34 

0.34 

1.07 

0.55 

1.17 

0.73 

- 0.01 

0.30 

0.81 

50238 

- 2.28 

50 

45 

0.50 

1.03 

0.19 

0.69 

- 0.36 

- 0.01 

0.32 

1.03 

50239 

- 2.43 

49 

44 

0.52 

0.78 

- 0.64 

0.44 

- 0.40 

- 0.01 

0.47 

1.20 

50240 

- 2.34 

50 

45 

0.52 

0.75 

- 0.68 

0.63 

- 0.38 

- 0.01 

0.46 

1.17 

50241 

- 1.17 

50 

41 

0.41 

0.81 

- 0.84 

0.61 

- 0.71 

- 0.01 

0.48 

1.26 

50242 

1.67 

48 

13 

0.36 

1.14 

0.80 

1.27 

0.86 

- 0.01 

0.30 

0.75 

50243 

- 1.17 

52 

41 

0.38 

0.66 

- 1.58 

0.48 

- 1.95 

- 0.01 

0.73 

1.38 

50244 

- 2.89 

50 

47 

0.69 

1.01 

0.19 

0.69 

0.11 

- 0.01 

0.37 

1.00 

50245 

- 1.69 

50 

40 

0.41 

0.71 

- 1.35 

0.49 

- 1.15 

- 0.01 

0.60 

1.34 

50246 

- 0.69 

49 

34 

0.34 

1.11 

0.78 

2.09 

3.42 

- 0.01 

0.23 

0.48 

50247 

- 1.80 

275 

254 

0.24 

1.03 

0.22 

1.60 

1.56 

0.00 

0.21 

0.98 

50248 

- 2.38 

50 

46 

0.56 

0.98 

0.08 

0.57 

- 0.23 

- 0.01 

0.35 

1.06 

50249 

- 0.74 

49 

34 

0.37 

0.73 

- 1.66 

0.55 

- 1.47 

- 0.01 

0.63 

1.49 

50250 

0.21 

51 

29 

0.32 

1.03 

0.29 

1.04 

0.24 

- 0.01 

0.43 

0.91 

50251 

- 2.07 

52 

48 

0.55 

1.04 

0.23 

0.62 

- 0.29 

- 0.01 

0.28 

1.03 

50252 

- 1.86 

57 

49 

0.42 

0.80 

- 0.72 

0.56 

- 0.79 

- 0.01 

0.52 

1.19 

50253 

- 2.57 

51 

47 

0.54 

1.14 

0.47 

0.99 

0.25 

- 0.01 

0.14 

0.92 

50254 

- 2.38 

48 

44 

0.55 

0.85 

- 0.27 

0.82 

- 0.06 

- 0.01 

0.33 

1.08 

50255 

- 3.79 

48 

47 

1.03 

1.02 

0.33 

0.48 

0.01 

- 0.01 

0.17 

1.02 

50256 

- 2.09 

51 

45 

0.48 

0.95 

- 0.05 

1.35 

0.68 

- 0.01 

0.36 

0.98 

50257 

- 2.47 

49 

46 

0.62 

1.11 

0.39 

2.26 

1.25 

- 0.01 

0.08 

0.81 

50258 

- 2.27 

47 

43 

0.55 

0.85 

- 0.28 

0.56 

- 0.40 

- 0.01 

0.40 

1.12 

50259 

- 1.80 

52 

44 

0.41 

1.01 

0.13 

1.06 

0.27 

- 0.01 

0.27 

0.97 

50260 

- 1.76 

50 

42 

0.42 

0.74 

- 1.04 

0.48 

- 0.93 

- 0.01 

0.53 

1.28 

50261 

- 2.86 

50 

47 

0.62 

0.94 

0.04 

0.64 

- 0.13 

- 0.01 

0.26 

1.05 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50262 

- 1.60 

52 

44 

0.43 

1.09 

0.44 

1.07 

0.31 

- 0.01 

0.31 

0.90 

50263 

- 2.51 

50 

46 

0.54 

0.93 

- 0.06 

0.58 

- 0.39 

- 0.01 

0.32 

1.08 

50264 

- 1.39 

52 

43 

0.40 

0.95 

- 0.12 

0.80 

- 0.30 

- 0.01 

0.40 

1.08 

50265 

- 0.91 

49 

36 

0.36 

1.03 

0.24 

1.09 

0.38 

- 0.01 

0.41 

0.95 

50266 

- 1.83 

51 

43 

0.43 

0.95 

- 0.12 

0.60 

- 0.57 

- 0.01 

0.45 

1.11 

50267 

- 1.55 

50 

44 

0.46 

1.01 

0.14 

0.71 

- 0.32 

- 0.01 

0.30 

1.03 

50268 

- 2.28 

51 

47 

0.54 

0.80 

- 0.40 

0.36 

- 0.77 

- 0.01 

0.42 

1.17 

50269 

- 1.46 

51 

43 

0.42 

1.30 

1.15 

1.71 

1.37 

- 0.01 

0.13 

0.68 

50270 

- 1.81 

55 

48 

0.44 

1.04 

0.24 

0.73 

- 0.35 

- 0.01 

0.36 

1.01 

50271 

0.66 

50 

19 

0.32 

1.06 

0.54 

1.05 

0.30 

- 0.01 

0.35 

0.84 

50272 

- 1.89 

49 

42 

0.44 

1.04 

0.24 

0.85 

- 0.15 

- 0.01 

0.30 

0.99 

50273 

- 2.98 

51 

48 

0.62 

1.04 

0.24 

0.90 

0.21 

- 0.01 

0.20 

0.98 

50274 

- 0.47 

48 

34 

0.34 

0.88 

- 0.77 

0.82 

- 0.61 

- 0.01 

0.45 

1.25 

50275 

- 2.23 

49 

43 

0.49 

1.55 

1.57 

1.75 

1.13 

- 0.01 

0.11 

0.57 

50276 

- 1.64 

52 

43 

0.39 

0.83 

- 0.68 

0.68 

- 0.75 

- 0.01 

0.49 

1.19 

50277 

- 2.11 

54 

48 

0.50 

0.87 

- 0.27 

0.53 

- 0.54 

- 0.01 

0.50 

1.12 

50278 

- 2.74 

52 

49 

0.61 

0.88 

- 0.08 

0.81 

- 0.02 

- 0.01 

0.27 

1.06 

50279 

- 2.45 

48 

44 

0.55 

0.94 

0.00 

1.06 

0.31 

- 0.01 

0.27 

1.03 

50280 

- 1.86 

269 

253 

0.27 

0.89 

- 0.45 

0.53 

- 1.38 

0.00 

0.33 

1.09 

50281 

- 2.53 

53 

49 

0.55 

0.77 

- 0.48 

0.42 

- 0.59 

- 0.01 

0.39 

1.16 

50282 

- 2.25 

52 

46 

0.49 

1.33 

0.99 

0.95 

0.15 

- 0.01 

0.27 

0.84 

50283 

- 2.74 

52 

47 

0.49 

0.94 

- 0.07 

0.93 

0.10 

- 0.01 

0.30 

1.03 

50284 

- 1.59 

52 

42 

0.39 

0.79 

- 0.98 

0.62 

- 0.90 

- 0.01 

0.56 

1.25 

50285 

- 1.87 

52 

45 

0.44 

0.74 

- 0.89 

0.49 

- 0.75 

- 0.01 

0.50 

1.24 

50286 

- 1.95 

50 

43 

0.44 

0.69 

- 1.21 

0.40 

- 1.22 

- 0.01 

0.60 

1.31 

50287 

- 1.99 

51 

43 

0.41 

0.78 

- 0.84 

0.55 

- 0.87 

- 0.01 

0.50 

1.24 

50288 

- 3.64 

56 

54 

0.76 

1.05 

0.28 

0.45 

- 0.20 

- 0.01 

0.28 

1.03 

50289 

1.64 

50 

17 

0.36 

1.11 

0.65 

2.53 

3.29 

- 0.01 

0.40 

0.59 

50290 

1.02 

51 

23 

0.33 

1.44 

2.74 

1.66 

2.40 

- 0.01 

0.26 

0.05 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50291 

0.24 

53 

27 

0.30 

1.29 

2.87 

1.75 

3.96 

-0.01 

0.03 

-0.39 

50292 

1.16 

56 

20 

0.31 

1.20 

1.52 

1.43 

1.42 

-0.01 

0.29 

0.46 

50293 

1.53 

52 

14 

0.36 

0.88 

-0.60 

0.82 

-0.45 

-0.01 

0.56 

1.17 

50294 

1.60 

51 

17 

0.34 

1.23 

1.50 

1.16 

0.49 

-0.01 

0.34 

0.57 

50295 

-0.65 

52 

35 

0.33 

1.36 

2.26 

1.34 

1.10 

-0.01 

0.16 

0.30 

50296 

-0.72 

52 

37 

0.34 

1.10 

0.63 

0.99 

0.06 

-0.01 

0.35 

0.88 

50297 

-0.36 

59 

40 

0.31 

1.04 

0.36 

1.04 

0.23 

-0.01 

0.41 

0.92 

50298 

-0.76 

51 

34 

0.33 

1.24 

1.66 

1.23 

0.87 

-0.01 

0.26 

0.49 

50299 

-0.29 

60 

40 

0.31 

1.13 

1.00 

1.04 

0.25 

-0.01 

0.34 

0.78 

50300 

-0.01 

51 

27 

0.32 

1.28 

2.14 

1.30 

1.52 

-0.01 

0.24 

0.28 

50301 

-1.33 

52 

42 

0.40 

1.16 

0.74 

1.06 

0.28 

-0.01 

0.36 

0.85 

50302 

-1.26 

51 

39 

0.37 

0.78 

-1.15 

0.76 

-0.62 

-0.01 

0.55 

1.27 

50303 

-1.51 

49 

41 

0.42 

0.75 

-1.05 

0.48 

-1.06 

-0.01 

0.53 

1.29 

50304 

-1.80 

50 

41 

0.40 

0.97 

-0.09 

0.66 

-0.48 

-0.01 

0.39 

1.11 

50305 

-1.51 

51 

42 

0.40 

0.78 

-0.96 

0.50 

-1.20 

-0.01 

0.53 

1.29 

50306 

-0.95 

52 

39 

0.37 

0.89 

-0.53 

0.86 

-0.26 

-0.01 

0.52 

1.14 

50307 

-1.33 

50 

39 

0.38 

0.95 

-0.18 

0.82 

-0.30 

-0.01 

0.43 

1.08 

50308 

-0.75 

57 

43 

0.34 

0.91 

-0.47 

1.07 

0.31 

-0.01 

0.48 

1.09 

50309 

-1.26 

53 

43 

0.38 

0.95 

-0.15 

0.79 

-0.48 

-0.01 

0.39 

1.09 

50310 

-1.28 

56 

47 

0.39 

0.74 

-1.07 

0.57 

-1.09 

-0.01 

0.56 

1.25 

50311 

-0.72 

48 

33 

0.36 

0.92 

-0.43 

0.72 

-0.83 

-0.01 

0.57 

1.19 

50312 

0.12 

54 

32 

0.30 

1.03 

0.33 

1.07 

0.47 

-0.01 

0.37 

0.87 

50313 

1.68 

55 

15 

0.34 

1.07 

0.46 

1.23 

0.65 

-0.01 

0.33 

0.84 

50314 

-0.48 

53 

34 

0.32 

1.04 

0.35 

1.07 

0.35 

-0.01 

0.39 

0.87 

50315 

-0.23 

52 

33 

0.32 

0.84 

-1.28 

0.74 

-1.29 

-0.01 

0.55 

1.44 

50316 

-0.92 

52 

39 

0.35 

0.95 

-0.23 

0.82 

-0.48 

-0.01 

0.42 

1.11 

50317 

-0.35 

52 

32 

0.32 

1.05 

0.46 

1.29 

1.36 

-0.01 

0.35 

0.76 

50318 

-0.42 

55 

38 

0.32 

0.93 

-0.52 

0.87 

-0.52 

-0.01 

0.44 

1.17 

50319 

-0.40 

58 

40 

0.31 

0.92 

-0.53 

0.77 

-1.06 

-0.01 

0.50 

1.21 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50320 

- 0.41 

53 

33 

0.33 

1.04 

0.32 

1.08 

0.36 

- 0.01 

0.46 

0.90 

50321 

- 0.07 

55 

35 

0.32 

1.28 

1.95 

1.61 

1.92 

- 0.01 

0.23 

0.30 

50322 

- 0.35 

49 

31 

0.33 

0.76 

- 2.03 

0.74 

- 1.05 

- 0.01 

0.57 

1.61 

50323 

0.88 

59 

24 

0.29 

1.04 

0.36 

0.96 

- 0.17 

- 0.01 

0.41 

0.95 

50324 

1.24 

53 

23 

0.32 

0.85 

- 1.08 

0.79 

- 0.95 

- 0.01 

0.61 

1.33 

50325 

0.06 

51 

28 

0.32 

1.05 

0.41 

0.97 

- 0.03 

- 0.01 

0.43 

0.92 

50326 

0.66 

45 

22 

0.33 

1.08 

0.64 

1.01 

0.09 

- 0.01 

0.40 

0.85 

50327 

0.26 

58 

34 

0.30 

0.97 

- 0.17 

0.95 

- 0.17 

- 0.01 

0.48 

1.07 

50328 

0.05 

50 

27 

0.33 

0.84 

- 1.16 

0.76 

- 0.87 

- 0.01 

0.59 

1.37 

50329 

- 0.13 

49 

30 

0.33 

0.99 

- 0.01 

1.01 

0.14 

- 0.01 

0.42 

1.00 

50330 

1.53 

54 

15 

0.34 

1.01 

0.09 

0.97 

- 0.02 

- 0.01 

0.43 

0.99 

50331 

0.36 

55 

26 

0.31 

0.82 

- 1.64 

0.75 

- 1.05 

- 0.01 

0.58 

1.51 

50332 

- 0.32 

57 

35 

0.31 

0.83 

- 1.31 

0.82 

- 0.72 

- 0.01 

0.55 

1.35 

50333 

- 0.54 

52 

35 

0.33 

1.04 

0.35 

0.98 

- 0.03 

- 0.01 

0.38 

0.94 

50334 

- 0.21 

52 

34 

0.31 

0.96 

- 0.26 

0.91 

- 0.46 

- 0.01 

0.42 

1.12 

50335 

- 0.52 

53 

39 

0.35 

1.12 

0.72 

1.05 

0.27 

- 0.01 

0.36 

0.85 

50336 

0.21 

52 

31 

0.31 

0.88 

- 1.06 

0.88 

- 0.57 

- 0.01 

0.51 

1.32 

50337 

0.65 

53 

28 

0.31 

0.75 

- 2.29 

0.71 

- 2.07 

- 0.01 

0.60 

1.76 

50338 

0.18 

52 

30 

0.32 

0.84 

- 1.25 

0.97 

- 0.05 

- 0.01 

0.56 

1.32 

50339 

0.47 

49 

26 

0.33 

0.89 

- 0.86 

0.97 

- 0.09 

- 0.01 

0.53 

1.23 

50340 

0.51 

51 

27 

0.33 

0.76 

- 1.98 

0.67 

- 1.74 

- 0.01 

0.60 

1.66 

50341 

- 0.86 

52 

39 

0.35 

1.10 

0.63 

1.16 

0.64 

- 0.01 

0.26 

0.82 

50342 

- 1.20 

54 

44 

0.38 

0.88 

- 0.52 

0.65 

- 0.96 

- 0.01 

0.46 

1.18 

50343 

0.26 

51 

27 

0.34 

0.79 

- 1.43 

0.66 

- 1.55 

- 0.01 

0.63 

1.43 

50344 

- 1.69 

54 

45 

0.40 

0.78 

- 1.02 

0.50 

- 1.08 

- 0.01 

0.51 

1.28 

50345 

- 1.27 

50 

38 

0.36 

1.11 

0.62 

1.14 

0.45 

- 0.01 

0.29 

0.82 

50346 

- 1.69 

55 

45 

0.38 

0.97 

- 0.08 

0.86 

- 0.15 

- 0.01 

0.40 

1.05 

50347 

- 1.28 

49 

41 

0.42 

0.94 

- 0.13 

0.80 

- 0.36 

- 0.01 

0.40 

1.07 

50348 

0.55 

58 

28 

0.30 

1.21 

1.63 

1.30 

1.41 

- 0.01 

0.33 

0.47 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50349 

- 0.92 

56 

43 

0.36 

1.04 

0.26 

1.02 

0.19 

- 0.01 

0.40 

0.94 

50350 

- 2.24 

54 

49 

0.49 

0.99 

0.09 

0.59 

- 0.48 

- 0.01 

0.34 

1.05 

50351 

0.54 

55 

28 

0.31 

1.02 

0.24 

1.04 

0.26 

- 0.01 

0.46 

0.92 

50352 

0.13 

50 

26 

0.32 

1.11 

0.85 

1.04 

0.28 

- 0.01 

0.40 

0.78 

50353 

- 0.52 

51 

34 

0.34 

1.04 

0.31 

1.02 

0.14 

- 0.01 

0.43 

0.93 

50354 

0.01 

53 

29 

0.31 

1.10 

0.83 

1.02 

0.17 

- 0.01 

0.41 

0.80 

50355 

- 0.17 

51 

32 

0.32 

0.99 

- 0.06 

0.95 

- 0.18 

- 0.01 

0.44 

1.05 

50356 

- 0.02 

54 

33 

0.31 

1.17 

1.35 

1.24 

1.18 

- 0.01 

0.29 

0.53 

50357 

- 0.53 

55 

41 

0.34 

1.07 

0.45 

0.93 

- 0.13 

- 0.01 

0.34 

0.94 

50358 

- 0.55 

53 

38 

0.34 

0.84 

- 1.00 

0.69 

- 0.97 

- 0.01 

0.53 

1.31 

50359 

0.10 

53 

30 

0.30 

1.02 

0.21 

0.98 

- 0.06 

- 0.01 

0.37 

0.96 

50360 

0.18 

53 

30 

0.32 

1.12 

0.93 

1.04 

0.25 

- 0.01 

0.43 

0.77 

50361 

- 2.99 

52 

49 

0.61 

0.83 

- 0.21 

0.34 

- 0.75 

- 0.01 

0.42 

1.14 

50362 

- 1.76 

53 

46 

0.44 

0.85 

- 0.48 

0.67 

- 0.35 

- 0.01 

0.42 

1.13 

50363 

- 2.28 

2785 

2521 

0.07 

0.93 

- 1.49 

0.79 

- 2.09 

- 0.01 

0.36 

1.06 

50364 

- 2.12 

54 

48 

0.46 

0.95 

- 0.07 

0.67 

- 0.29 

- 0.01 

0.34 

1.06 

50365 

1.80 

290 

127 

0.13 

0.98 

- 0.43 

1.08 

0.94 

0.00 

0.46 

1.03 

50366 

- 2.85 

53 

50 

0.62 

1.10 

0.37 

0.73 

0.00 

- 0.01 

0.19 

0.96 

50367 

- 2.06 

50 

45 

0.51 

1.02 

0.17 

1.13 

0.41 

- 0.01 

0.28 

0.95 

50368 

- 0.18 

52 

34 

0.32 

1.00 

0.04 

0.87 

- 0.52 

- 0.01 

0.45 

1.06 

50369 

0.66 

53 

24 

0.32 

1.00 

0.07 

1.01 

0.14 

- 0.01 

0.48 

0.98 

50370 

2.44 

51 

11 

0.40 

0.93 

- 0.21 

1.93 

1.69 

- 0.01 

0.47 

0.98 

50371 

0.38 

54 

25 

0.31 

0.94 

- 0.53 

0.89 

- 0.67 

- 0.01 

0.49 

1.21 

50372 

2.01 

50 

11 

0.37 

1.24 

1.20 

1.55 

1.59 

- 0.01 

0.10 

0.65 

50373 

- 0.35 

52 

33 

0.33 

1.02 

0.17 

0.92 

- 0.25 

- 0.01 

0.48 

1.01 

50374 

0.61 

52 

25 

0.32 

1.03 

0.26 

0.95 

- 0.20 

- 0.01 

0.48 

0.98 

50375 

0.55 

53 

26 

0.31 

1.27 

2.20 

1.37 

1.81 

- 0.01 

0.22 

0.18 

50376 

2.29 

50 

11 

0.41 

0.77 

- 0.96 

0.50 

- 1.20 

- 0.01 

0.68 

1.28 

50377 

0.59 

54 

25 

0.31 

1.16 

1.30 

1.41 

1.93 

- 0.01 

0.32 

0.48 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50378 

0.51 

52 

26 

0.31 

0.88 

- 1.08 

0.80 

- 1.23 

- 0.01 

0.55 

1.40 

50379 

2.19 

54 

10 

0.40 

0.80 

- 0.80 

0.66 

- 0.82 

- 0.01 

0.59 

1.20 

50380 

0.70 

45 

21 

0.32 

1.12 

1.07 

1.15 

0.97 

- 0.01 

0.27 

0.57 

50381 

0.50 

55 

27 

0.30 

1.10 

0.94 

1.06 

0.42 

- 0.01 

0.34 

0.72 

50382 

- 0.46 

52 

35 

0.33 

1.05 

0.40 

1.05 

0.26 

- 0.01 

0.39 

0.87 

50383 

- 0.11 

50 

32 

0.33 

0.93 

- 0.54 

0.75 

- 0.95 

- 0.01 

0.52 

1.25 

50384 

- 0.83 

53 

40 

0.35 

0.87 

- 0.68 

0.75 

- 0.69 

- 0.01 

0.50 

1.20 

50385 

- 0.45 

49 

32 

0.36 

1.07 

0.47 

0.97 

0.04 

- 0.01 

0.50 

0.90 

50386 

- 1.36 

50 

39 

0.38 

0.97 

- 0.05 

0.88 

- 0.15 

- 0.01 

0.46 

1.04 

50387 

- 1.45 

52 

43 

0.39 

0.93 

- 0.24 

0.75 

- 0.47 

- 0.01 

0.38 

1.10 

50388 

- 2.08 

52 

47 

0.50 

0.86 

- 0.32 

0.50 

- 0.62 

- 0.01 

0.42 

1.14 

50389 

- 2.31 

51 

48 

0.61 

0.86 

- 0.13 

0.90 

0.15 

- 0.01 

0.30 

1.07 

50390 

- 2.61 

53 

49 

0.54 

0.99 

0.12 

0.70 

- 0.17 

- 0.01 

0.26 

1.03 

50391 

- 1.36 

54 

44 

0.38 

0.88 

- 0.50 

0.68 

- 0.69 

- 0.01 

0.46 

1.17 

50392 

- 1.95 

53 

48 

0.49 

1.06 

0.29 

1.00 

0.24 

- 0.01 

0.22 

0.96 

50393 

- 1.96 

52 

47 

0.50 

0.83 

- 0.35 

0.88 

0.06 

- 0.01 

0.40 

1.09 

50394 

- 2.01 

51 

45 

0.46 

1.04 

0.23 

0.72 

- 0.29 

- 0.01 

0.31 

1.01 

50395 

- 0.79 

53 

40 

0.35 

0.73 

- 1.58 

0.56 

- 1.39 

- 0.01 

0.59 

1.42 

50396 

- 0.86 

306 

262 

0.17 

0.90 

- 0.86 

0.73 

- 1.30 

0.00 

0.40 

1.11 

50397 

- 0.99 

51 

37 

0.35 

0.87 

- 0.80 

0.82 

- 0.48 

- 0.01 

0.50 

1.22 

50398 

- 1.10 

52 

41 

0.36 

0.93 

- 0.30 

1.03 

0.19 

- 0.01 

0.38 

1.06 

50399 

- 3.98 

49 

47 

1.03 

1.01 

0.32 

0.40 

- 0.09 

- 0.01 

0.59 

1.03 

50400 

- 0.33 

52 

33 

0.32 

0.97 

- 0.19 

0.94 

- 0.26 

- 0.01 

0.47 

1.08 

50401 

- 1.18 

54 

43 

0.36 

1.16 

0.83 

1.18 

0.50 

- 0.01 

0.21 

0.77 

50402 

- 2.33 

49 

44 

0.51 

1.29 

0.88 

2.92 

2.06 

- 0.01 

0.02 

0.66 

50403 

0.84 

50 

19 

0.32 

1.02 

0.19 

1.07 

0.44 

- 0.01 

0.40 

0.92 

50404 

- 0.80 

49 

37 

0.36 

1.14 

0.81 

1.72 

1.59 

- 0.01 

0.23 

0.70 

50405 

- 0.33 

50 

33 

0.33 

1.01 

0.15 

0.91 

- 0.30 

- 0.01 

0.42 

1.01 

50406 

- 2.38 

50 

44 

0.47 

1.07 

0.33 

1.03 

0.26 

- 0.01 

0.27 

0.96 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50407 

- 0.27 

51 

35 

0.35 

1.04 

0.27 

1.29 

1.06 

- 0.01 

0.43 

0.88 

50408 

0.38 

50 

28 

0.32 

0.78 

- 1.90 

0.73 

- 1.68 

- 0.01 

0.61 

1.61 

50409 

0.18 

49 

28 

0.33 

1.02 

0.23 

1.01 

0.09 

- 0.01 

0.44 

0.94 

50410 

0.73 

52 

25 

0.31 

1.04 

0.39 

1.17 

1.12 

- 0.01 

0.35 

0.79 

50411 

0.12 

48 

30 

0.34 

1.50 

3.15 

1.87 

2.88 

- 0.01 

0.09 

- 0.24 

50412 

0.59 

57 

26 

0.30 

1.13 

1.19 

1.14 

0.75 

- 0.01 

0.34 

0.62 

50413 

0.62 

50 

23 

0.33 

1.12 

0.83 

1.08 

0.45 

- 0.01 

0.42 

0.77 

50414 

- 3.60 

50 

48 

0.84 

0.76 

- 0.13 

0.51 

- 0.02 

- 0.01 

0.46 

1.08 

50415 

- 3.99 

52 

50 

1.02 

1.05 

0.37 

2.09 

1.06 

- 0.01 

0.43 

0.91 

50416 

- 0.04 

297 

222 

0.15 

1.00 

0.02 

0.92 

- 0.52 

0.00 

0.38 

1.02 

50417 

- 1.42 

55 

46 

0.39 

1.22 

0.96 

1.49 

1.01 

- 0.01 

0.12 

0.71 

50418 

- 0.59 

49 

35 

0.35 

1.46 

2.44 

1.54 

1.67 

- 0.01 

0.09 

0.25 

50419 

- 0.89 

49 

38 

0.36 

1.11 

0.61 

1.08 

0.35 

- 0.01 

0.19 

0.85 

50420 

0.00 

49 

49 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

50421 

- 0.07 

50 

32 

0.33 

1.19 

1.46 

1.57 

1.99 

- 0.01 

0.25 

0.40 

50422 

- 1.11 

51 

39 

0.36 

1.06 

0.38 

0.89 

- 0.16 

- 0.01 

0.35 

0.96 

50423 

- 0.83 

47 

35 

0.36 

1.07 

0.45 

1.12 

0.49 

- 0.01 

0.27 

0.85 

50424 

- 1.18 

50 

39 

0.38 

1.06 

0.35 

0.98 

0.10 

- 0.01 

0.38 

0.94 

50425 

0.31 

63 

38 

0.29 

0.85 

- 1.19 

0.73 

- 1.36 

- 0.01 

0.59 

1.36 

50426 

0.11 

57 

31 

0.30 

1.25 

2.15 

1.41 

2.00 

- 0.01 

0.21 

0.19 

50427 

1.18 

49 

22 

0.32 

0.88 

- 1.00 

0.79 

- 1.33 

- 0.01 

0.54 

1.41 

50428 

- 0.17 

53 

33 

0.32 

0.80 

- 1.50 

0.69 

- 1.42 

- 0.01 

0.62 

1.45 

50429 

0.71 

50 

23 

0.33 

0.92 

- 0.55 

0.90 

- 0.47 

- 0.01 

0.54 

1.19 

50430 

0.64 

66 

34 

0.28 

1.02 

0.19 

0.94 

- 0.25 

- 0.01 

0.47 

1.00 

50431 

- 0.10 

295 

229 

0.16 

0.88 

- 1.51 

0.70 

- 2.00 

0.00 

0.50 

1.19 

50432 

0.02 

51 

29 

0.32 

1.31 

2.22 

1.81 

2.83 

- 0.01 

0.25 

0.12 

50433 

- 3.02 

46 

43 

0.62 

1.17 

0.49 

1.18 

0.49 

- 0.01 

0.11 

0.89 

50434 

- 2.91 

54 

51 

0.61 

1.09 

0.34 

1.18 

0.49 

- 0.01 

0.09 

0.93 

50435 

- 0.56 

57 

39 

0.32 

1.13 

0.86 

1.51 

1.83 

- 0.01 

0.32 

0.66 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50436 

- 1.38 

52 

43 

0.39 

1.31 

1.34 

1.51 

1.10 

- 0.01 

0.07 

0.63 

50437 

- 1.88 

54 

46 

0.42 

0.86 

- 0.47 

0.63 

- 0.71 

- 0.01 

0.48 

1.15 

50438 

- 0.44 

57 

40 

0.33 

1.16 

0.99 

1.08 

0.35 

- 0.01 

0.38 

0.78 

50439 

1.77 

59 

19 

0.32 

1.56 

3.12 

1.70 

2.43 

- 0.01 

0.11 

0.06 

50440 

1.99 

60 

15 

0.33 

1.31 

1.81 

1.74 

2.05 

- 0.01 

0.14 

0.45 

50441 

2.55 

58 

11 

0.37 

1.15 

0.74 

1.70 

1.36 

0.00 

0.24 

0.73 

50442 

2.46 

54 

10 

0.39 

1.07 

0.38 

1.47 

1.09 

- 0.01 

0.29 

0.85 

50443 

2.09 

54 

12 

0.38 

1.56 

2.26 

2.22 

2.53 

- 0.01 

0.07 

0.29 

50444 

1.29 

48 

14 

0.34 

1.15 

0.97 

1.16 

0.61 

- 0.01 

0.22 

0.71 

50445 

0.29 

59 

32 

0.29 

1.12 

1.19 

1.13 

0.86 

- 0.01 

0.30 

0.61 

50446 

0.51 

55 

27 

0.30 

1.10 

0.82 

1.11 

0.72 

- 0.01 

0.37 

0.72 

50447 

1.06 

59 

22 

0.30 

1.33 

2.46 

1.65 

2.21 

- 0.01 

0.16 

0.12 

50448 

- 0.50 

52 

33 

0.31 

0.97 

- 0.18 

0.90 

- 0.46 

- 0.01 

0.42 

1.11 

50449 

0.75 

59 

28 

0.30 

1.07 

0.57 

1.06 

0.40 

- 0.01 

0.43 

0.85 

50450 

0.44 

54 

26 

0.30 

0.87 

- 1.21 

0.79 

- 1.34 

- 0.01 

0.56 

1.43 

50451 

- 2.09 

50 

44 

0.46 

0.85 

- 0.40 

0.55 

- 0.63 

- 0.01 

0.43 

1.15 

50452 

- 3.04 

59 

57 

0.73 

1.05 

0.29 

0.89 

0.24 

- 0.01 

0.10 

0.97 

50453 

- 1.10 

57 

44 

0.34 

0.90 

- 0.52 

0.89 

- 0.21 

- 0.01 

0.42 

1.12 

50454 

- 2.79 

57 

53 

0.55 

1.07 

0.29 

1.54 

0.82 

- 0.01 

0.16 

0.88 

50455 

- 1.95 

59 

53 

0.45 

1.04 

0.23 

1.03 

0.25 

- 0.01 

0.24 

0.97 

50456 

- 0.84 

61 

48 

0.34 

1.04 

0.30 

1.01 

0.16 

- 0.01 

0.33 

0.94 

50457 

- 2.41 

53 

47 

0.48 

0.85 

- 0.41 

2.13 

1.49 

- 0.01 

0.38 

1.02 

50458 

- 2.74 

62 

59 

0.62 

0.75 

- 0.39 

0.41 

- 0.46 

- 0.01 

0.40 

1.14 

50459 

- 1.50 

49 

42 

0.43 

1.22 

0.85 

1.40 

0.90 

- 0.01 

0.03 

0.75 

50460 

- 0.87 

60 

46 

0.33 

1.29 

1.63 

1.31 

0.99 

- 0.01 

0.15 

0.60 

50461 

- 0.38 

58 

41 

0.31 

1.10 

0.75 

1.07 

0.38 

- 0.01 

0.30 

0.83 

50462 

- 0.52 

55 

38 

0.33 

0.89 

- 0.65 

1.06 

0.31 

- 0.01 

0.50 

1.12 

50463 

- 1.04 

49 

35 

0.34 

1.08 

0.56 

1.22 

0.87 

- 0.01 

0.28 

0.80 

50464 

- 0.72 

51 

37 

0.35 

1.26 

1.42 

1.13 

0.51 

- 0.01 

0.26 

0.67 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50465 

-1.72 

53 

47 

0.46 

0.95 

-0.07 

0.61 

-0.52 

-0.01 

0.36 

1.09 

50466 

-1.02 

58 

45 

0.34 

0.81 

-1.08 

0.68 

-0.89 

-0.01 

0.52 

1.27 

50467 

0.03 

58 

32 

0.30 

1.05 

0.47 

1.37 

1.66 

-0.01 

0.41 

0.76 

50468 

0.69 

49 

22 

0.32 

1.15 

1.16 

1.36 

1.88 

-0.01 

0.29 

0.51 

50469 

1.12 

52 

19 

0.32 

1.32 

2.27 

1.34 

0.89 

-0.01 

0.17 

0.23 

50470 

1.49 

55 

18 

0.33 

1.03 

0.24 

0.98 

0.01 

-0.01 

0.45 

0.96 

50471 

0.24 

51 

28 

0.32 

0.92 

-0.61 

0.92 

-0.35 

-0.01 

0.52 

1.19 

50472 

0.29 

52 

28 

0.31 

1.04 

0.34 

1.05 

0.34 

-0.01 

0.43 

0.89 

50473 

1.18 

60 

22 

0.31 

0.93 

-0.46 

0.83 

-0.66 

-0.01 

0.54 

1.16 

50474 

-0.72 

61 

44 

0.32 

1.01 

0.12 

0.82 

-0.47 

-0.01 

0.45 

1.04 

50475 

-0.78 

55 

41 

0.34 

0.82 

-1.09 

0.67 

-1.17 

-0.01 

0.55 

1.30 

50476 

-0.03 

52 

31 

0.32 

0.91 

-0.67 

0.84 

-0.70 

-0.01 

0.54 

1.23 

50477 

-1.50 

55 

47 

0.41 

0.69 

-1.25 

0.44 

-1.17 

-0.01 

0.58 

1.30 

50478 

-0.09 

54 

36 

0.32 

0.97 

-0.24 

0.81 

-0.63 

-0.01 

0.44 

1.15 

50479 

0.62 

50 

25 

0.32 

0.81 

-1.68 

1.07 

0.42 

-0.01 

0.54 

1.45 

50480 

0.50 

52 

26 

0.31 

0.96 

-0.30 

1.04 

0.27 

-0.01 

0.45 

1.06 

50481 

-1.47 

49 

40 

0.39 

0.87 

-0.52 

0.68 

-0.68 

-0.01 

0.45 

1.17 

50482 

-2.33 

61 

55 

0.46 

0.86 

-0.37 

0.77 

-0.07 

-0.01 

0.40 

1.11 

50483 

-2.74 

60 

55 

0.50 

0.90 

-0.17 

0.42 

-0.61 

-0.01 

0.40 

1.12 

50484 

-1.85 

48 

42 

0.48 

0.71 

-0.89 

0.47 

-0.72 

-0.01 

0.56 

1.24 

50485 

-1.66 

56 

48 

0.41 

0.90 

-0.33 

2.31 

1.85 

-0.01 

0.29 

0.98 

50486 

-1.03 

54 

42 

0.37 

0.93 

-0.27 

0.69 

-0.70 

-0.01 

0.50 

1.13 

50487 

-2.86 

50 

47 

0.62 

0.94 

0.03 

0.71 

0.04 

-0.01 

0.26 

1.03 

50488 

-2.55 

49 

46 

0.62 

1.09 

0.35 

0.66 

-0.19 

-0.01 

0.23 

1.00 

50489 

-4.13 

49 

48 

1.03 

1.01 

0.31 

0.38 

-0.11 

-0.01 

0.19 

1.03 

50490 

-1.35 

52 

44 

0.40 

0.87 

-0.47 

0.61 

-0.93 

-0.01 

0.43 

1.17 

50491 

0.26 

50 

26 

0.31 

0.88 

-1.11 

0.84 

-1.10 

-0.01 

0.49 

1.44 

50492 

-0.32 

49 

33 

0.35 

1.22 

1.32 

1.18 

0.73 

-0.01 

0.31 

0.65 

50493 

-0.51 

46 

32 

0.36 

0.94 

-0.30 

0.83 

-0.52 

-0.01 

0.48 

1.13 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50494 

- 0.07 

49 

26 

0.32 

0.95 

- 0.36 

0.93 

- 0.27 

- 0.01 

0.49 

1.13 

50495 

- 1.53 

55 

46 

0.40 

0.91 

- 0.29 

0.64 

- 0.55 

- 0.01 

0.46 

1.13 

50496 

- 1.51 

55 

46 

0.39 

1.04 

0.25 

0.81 

- 0.31 

- 0.01 

0.30 

1.01 

50497 

- 0.58 

53 

35 

0.33 

0.89 

- 0.70 

0.82 

- 0.79 

- 0.01 

0.52 

1.22 

50498 

- 1.22 

58 

47 

0.36 

0.81 

- 0.98 

0.78 

- 0.43 

- 0.01 

0.47 

1.22 

50499 

0.16 

60 

35 

0.30 

1.10 

0.80 

1.31 

1.37 

- 0.01 

0.40 

0.72 

50500 

- 0.95 

57 

46 

0.36 

0.84 

- 0.73 

0.85 

- 0.27 

- 0.01 

0.47 

1.16 

50501 

0.55 

55 

29 

0.31 

1.00 

0.02 

0.97 

- 0.12 

- 0.01 

0.48 

1.02 

50502 

0.03 

50 

30 

0.33 

1.14 

0.98 

1.17 

0.82 

- 0.01 

0.37 

0.71 

50503 

0.87 

52 

23 

0.31 

1.06 

0.55 

1.04 

0.27 

- 0.01 

0.38 

0.83 

50504 

1.42 

53 

19 

0.33 

0.80 

- 1.28 

0.77 

- 1.06 

- 0.01 

0.64 

1.35 

50505 

1.46 

53 

15 

0.35 

1.00 

0.05 

1.21 

0.71 

- 0.01 

0.44 

0.96 

50506 

1.93 

58 

14 

0.35 

1.18 

0.98 

2.38 

2.78 

0.00 

0.26 

0.61 

50507 

1.05 

53 

20 

0.32 

1.22 

1.53 

1.36 

1.57 

- 0.01 

0.26 

0.47 

50508 

0.11 

57 

32 

0.31 

1.08 

0.64 

1.21 

0.96 

- 0.01 

0.41 

0.76 

50509 

- 0.15 

55 

34 

0.31 

0.90 

- 0.75 

0.81 

- 0.91 

- 0.01 

0.53 

1.27 

50510 

- 3.26 

55 

53 

0.73 

1.04 

0.28 

0.69 

0.06 

- 0.01 

0.16 

0.99 

50511 

- 1.83 

264 

249 

0.28 

0.95 

- 0.15 

0.58 

- 0.93 

0.00 

0.31 

1.05 

50512 

- 2.09 

52 

46 

0.47 

0.83 

- 0.46 

0.52 

- 0.81 

- 0.01 

0.49 

1.17 

50513 

- 0.50 

53 

36 

0.33 

0.82 

- 1.26 

0.71 

- 0.97 

- 0.01 

0.56 

1.37 

50514 

- 3.40 

54 

52 

0.76 

0.75 

- 0.23 

0.35 

- 0.36 

- 0.01 

0.34 

1.12 

50515 

- 3.37 

55 

53 

0.75 

1.14 

0.42 

0.96 

0.35 

- 0.01 

0.12 

0.93 

50516 

- 2.32 

54 

49 

0.50 

0.86 

- 0.30 

0.64 

- 0.16 

- 0.01 

0.37 

1.10 

50517 

- 1.51 

55 

48 

0.43 

1.42 

1.39 

4.33 

3.69 

- 0.01 

- 0.15 

0.45 

50518 

- 3.28 

50 

48 

0.74 

0.81 

- 0.13 

0.24 

- 0.68 

- 0.01 

0.38 

1.14 

50519 

- 1.69 

50 

41 

0.40 

0.88 

- 0.45 

0.78 

- 0.54 

- 0.01 

0.46 

1.13 

50520 

- 1.95 

52 

46 

0.45 

1.06 

0.30 

1.19 

0.50 

- 0.01 

0.17 

0.92 

50521 

0.79 

55 

27 

0.30 

1.18 

1.50 

1.27 

1.18 

- 0.01 

0.32 

0.47 

50522 

0.15 

53 

33 

0.33 

1.01 

0.13 

0.94 

- 0.12 

- 0.01 

0.50 

1.00 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50523 

- 0.28 

55 

37 

0.32 

1.07 

0.56 

1.12 

0.50 

- 0.01 

0.37 

0.82 

50524 

- 1.05 

50 

36 

0.36 

1.06 

0.42 

0.88 

- 0.24 

- 0.01 

0.46 

0.96 

50525 

- 0.62 

62 

47 

0.33 

0.73 

- 1.77 

0.60 

- 1.15 

- 0.01 

0.60 

1.39 

50526 

0.29 

61 

36 

0.30 

0.76 

- 2.16 

0.64 

- 1.79 

- 0.01 

0.64 

1.60 

50527 

- 1.16 

52 

41 

0.38 

0.93 

- 0.24 

0.71 

- 0.73 

- 0.01 

0.50 

1.12 

50528 

- 0.21 

50 

31 

0.33 

1.05 

0.42 

1.07 

0.38 

- 0.01 

0.40 

0.86 

50529 

1.08 

50 

18 

0.32 

0.95 

- 0.33 

0.85 

- 0.76 

- 0.01 

0.45 

1.18 

50530 

- 0.05 

50 

29 

0.32 

0.96 

- 0.23 

0.95 

- 0.16 

- 0.01 

0.49 

1.08 

50531 

1.03 

57 

27 

0.30 

1.11 

0.89 

1.14 

0.81 

- 0.01 

0.39 

0.74 

50532 

2.18 

59 

13 

0.37 

0.98 

- 0.04 

1.75 

1.57 

0.00 

0.49 

0.93 

50533 

- 1.49 

51 

42 

0.41 

0.94 

- 0.17 

1.05 

0.25 

- 0.01 

0.39 

1.03 

50534 

- 2.53 

56 

51 

0.50 

0.90 

- 0.20 

0.41 

- 0.58 

- 0.01 

0.40 

1.14 

50535 

1.78 

50 

13 

0.36 

1.13 

0.72 

1.71 

1.83 

- 0.01 

0.29 

0.69 

50536 

0.98 

50 

18 

0.34 

1.48 

2.59 

2.79 

4.39 

- 0.01 

0.11 

- 0.07 

50537 

- 0.97 

49 

37 

0.36 

0.74 

- 1.51 

0.65 

- 1.01 

- 0.01 

0.59 

1.38 

50538 

- 1.59 

50 

40 

0.39 

0.73 

- 1.26 

0.51 

- 1.01 

- 0.01 

0.59 

1.33 

50539 

0.48 

289 

203 

0.14 

0.90 

- 1.60 

0.84 

- 1.17 

0.00 

0.49 

1.19 

50540 

0.46 

282 

199 

0.14 

0.95 

- 0.75 

0.93 

- 0.55 

0.00 

0.46 

1.09 

50541 

0.15 

53 

32 

0.33 

0.86 

- 1.01 

0.74 

- 1.15 

- 0.01 

0.59 

1.34 

50542 

- 1.15 

49 

38 

0.37 

0.90 

- 0.48 

0.94 

- 0.06 

- 0.01 

0.41 

1.11 

50543 

0.49 

60 

31 

0.30 

0.84 

- 1.36 

0.76 

- 1.24 

- 0.01 

0.60 

1.40 

50544 

- 0.56 

50 

34 

0.34 

0.98 

- 0.07 

0.95 

- 0.06 

- 0.01 

0.44 

1.04 

50545 

- 0.94 

271 

238 

0.20 

0.97 

- 0.21 

0.71 

- 1.10 

0.00 

0.37 

1.06 

50546 

- 1.53 

54 

45 

0.39 

1.00 

0.10 

0.88 

- 0.13 

- 0.01 

0.36 

1.02 

50547 

0.37 

51 

25 

0.32 

0.90 

- 0.80 

1.34 

1.36 

- 0.01 

0.52 

1.13 

50548 

0.07 

50 

29 

0.32 

0.81 

- 1.59 

0.69 

- 1.34 

- 0.01 

0.60 

1.52 

50549 

- 0.28 

55 

37 

0.33 

1.05 

0.39 

1.07 

0.34 

- 0.01 

0.43 

0.90 

50550 

- 0.34 

50 

31 

0.32 

0.96 

- 0.28 

0.83 

- 0.65 

- 0.01 

0.44 

1.18 

50551 

- 0.70 

56 

39 

0.34 

1.15 

0.98 

1.89 

1.93 

- 0.01 

0.37 

0.63 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50552 

- 1.93 

53 

46 

0.46 

1.01 

0.13 

0.61 

- 0.47 

- 0.01 

0.45 

1.06 

50553 

1.55 

49 

14 

0.37 

1.03 

0.24 

0.88 

- 0.29 

- 0.01 

0.49 

1.00 

50554 

- 1.17 

51 

40 

0.38 

1.26 

1.31 

1.24 

0.65 

- 0.01 

0.23 

0.67 

50555 

0.72 

49 

23 

0.31 

1.30 

2.52 

1.48 

2.39 

- 0.01 

0.12 

- 0.08 

50556 

- 1.13 

51 

37 

0.34 

1.19 

1.16 

1.44 

1.29 

- 0.01 

0.19 

0.60 

50557 

0.52 

51 

24 

0.32 

1.37 

2.61 

1.35 

1.61 

- 0.01 

0.23 

0.15 

50558 

- 4.13 

50 

49 

1.02 

1.06 

0.38 

1.54 

0.79 

- 0.01 

0.01 

0.93 

50559 

- 2.48 

50 

46 

0.55 

0.99 

0.11 

0.71 

- 0.13 

- 0.01 

0.28 

1.02 

50560 

- 4.48 

57 

56 

1.03 

1.04 

0.35 

0.41 

- 0.15 

- 0.01 

0.16 

1.01 

50561 

0.00 

53 

53 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

50562 

- 2.85 

52 

48 

0.55 

1.02 

0.18 

1.49 

0.78 

- 0.01 

0.21 

0.94 

50563 

- 2.23 

51 

46 

0.49 

1.04 

0.23 

1.88 

1.30 

- 0.01 

0.16 

0.90 

50564 

0.04 

51 

28 

0.33 

1.03 

0.25 

0.93 

- 0.24 

- 0.01 

0.50 

0.99 

50565 

- 0.29 

50 

34 

0.34 

1.23 

1.58 

1.32 

1.11 

- 0.01 

0.26 

0.49 

50566 

- 1.38 

52 

42 

0.39 

0.86 

- 0.54 

1.11 

0.40 

- 0.01 

0.46 

1.08 

50567 

- 0.62 

49 

33 

0.36 

0.88 

- 0.68 

0.86 

- 0.37 

- 0.01 

0.55 

1.19 

50568 

- 0.97 

54 

36 

0.34 

1.14 

1.00 

1.22 

0.70 

- 0.01 

0.41 

0.67 

50569 

- 0.80 

56 

36 

0.33 

0.75 

- 1.81 

0.61 

- 1.47 

- 0.01 

0.67 

1.46 

50570 

- 0.62 

48 

33 

0.36 

0.70 

- 1.91 

0.59 

- 1.40 

- 0.01 

0.68 

1.48 

50571 

- 1.53 

266 

236 

0.20 

0.83 

- 1.22 

0.53 

- 2.21 

0.00 

0.45 

1.16 

50572 

- 0.38 

51 

35 

0.33 

0.82 

- 1.34 

0.69 

- 1.46 

- 0.01 

0.57 

1.42 

50573 

- 1.14 

52 

41 

0.37 

0.93 

- 0.29 

0.77 

- 0.43 

- 0.01 

0.43 

1.12 

50574 

1.16 

59 

24 

0.30 

1.04 

0.33 

1.05 

0.32 

- 0.01 

0.44 

0.92 

50575 

- 1.05 

54 

42 

0.35 

0.66 

- 2.01 

0.49 

- 1.68 

- 0.01 

0.65 

1.48 

50576 

- 0.71 

58 

40 

0.33 

0.87 

- 0.85 

0.72 

- 0.88 

- 0.01 

0.56 

1.25 

50577 

- 2.21 

49 

44 

0.49 

1.03 

0.19 

1.33 

0.71 

- 0.01 

0.16 

0.95 

50578 

- 1.71 

50 

43 

0.44 

1.02 

0.18 

1.13 

0.42 

- 0.01 

0.30 

0.97 

50579 

- 2.23 

50 

44 

0.49 

1.13 

0.46 

5.74 

3.40 

- 0.01 

0.25 

0.75 

50580 

- 1.70 

51 

46 

0.50 

1.00 

0.12 

1.47 

0.85 

- 0.01 

0.22 

0.94 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50581 

- 2.93 

53 

50 

0.61 

1.06 

0.29 

1.03 

0.35 

- 0.01 

0.11 

0.95 

50582 

- 0.43 

56 

37 

0.32 

1.31 

2.10 

1.67 

2.20 

- 0.01 

0.23 

0.28 

50583 

- 0.51 

262 

213 

0.17 

0.82 

- 1.90 

0.70 

- 1.79 

0.00 

0.49 

1.21 

50584 

- 0.35 

49 

30 

0.33 

0.82 

- 1.43 

0.74 

- 1.05 

- 0.01 

0.56 

1.47 

50585 

- 0.75 

50 

37 

0.34 

1.00 

0.03 

0.86 

- 0.49 

- 0.01 

0.35 

1.06 

50586 

- 0.47 

50 

36 

0.33 

0.77 

- 1.66 

0.65 

- 1.37 

- 0.01 

0.55 

1.50 

50587 

0.28 

50 

26 

0.33 

0.82 

- 1.37 

0.75 

- 1.14 

- 0.01 

0.61 

1.43 

50588 

- 0.97 

49 

37 

0.37 

0.82 

- 1.06 

0.58 

- 1.06 

- 0.01 

0.55 

1.34 

50589 

- 0.79 

50 

33 

0.34 

1.02 

0.18 

1.30 

0.97 

- 0.01 

0.45 

0.91 

50590 

- 1.04 

48 

36 

0.36 

0.77 

- 1.28 

0.69 

- 1.02 

- 0.01 

0.58 

1.34 

50591 

- 0.65 

50 

35 

0.35 

0.81 

- 1.15 

0.79 

- 0.71 

- 0.01 

0.59 

1.30 

50592 

- 1.36 

50 

39 

0.38 

1.04 

0.25 

0.91 

- 0.06 

- 0.01 

0.39 

0.97 

50593 

- 0.08 

53 

30 

0.32 

0.99 

- 0.06 

1.03 

0.21 

- 0.01 

0.49 

0.99 

50594 

- 0.61 

54 

39 

0.33 

0.93 

- 0.37 

0.94 

- 0.13 

- 0.01 

0.46 

1.10 

50595 

- 1.84 

53 

45 

0.42 

0.94 

- 0.16 

1.03 

0.24 

- 0.01 

0.35 

1.03 

50596 

- 2.45 

56 

52 

0.54 

0.97 

0.07 

0.63 

- 0.17 

- 0.01 

0.26 

1.04 

50597 

0.44 

56 

33 

0.31 

1.03 

0.32 

1.08 

0.45 

- 0.01 

0.41 

0.87 

50598 

0.14 

53 

32 

0.31 

0.87 

- 1.15 

0.76 

- 1.24 

- 0.01 

0.53 

1.43 

50599 

- 1.89 

49 

40 

0.42 

0.62 

- 1.59 

0.53 

- 1.24 

- 0.01 

0.66 

1.35 

50600 

- 0.60 

55 

39 

0.33 

0.95 

- 0.29 

0.88 

- 0.34 

- 0.01 

0.45 

1.10 

50601 

- 1.84 

55 

47 

0.44 

0.75 

- 0.94 

1.99 

1.46 

- 0.01 

0.52 

1.12 

50602 

- 2.45 

51 

46 

0.51 

0.92 

- 0.10 

0.76 

- 0.10 

- 0.01 

0.34 

1.06 

50603 

- 2.13 

51 

47 

0.53 

0.90 

- 0.12 

0.59 

- 0.48 

- 0.01 

0.30 

1.09 

50604 

- 2.98 

51 

48 

0.63 

0.92 

- 0.01 

0.43 

- 0.27 

- 0.01 

0.33 

1.08 

50605 

- 1.99 

50 

44 

0.46 

0.77 

- 0.74 

0.47 

- 0.97 

- 0.01 

0.52 

1.22 

50606 

- 2.25 

55 

50 

0.51 

0.98 

0.06 

0.58 

- 0.40 

- 0.01 

0.36 

1.06 

50607 

- 2.50 

55 

48 

0.46 

1.11 

0.46 

0.67 

- 0.15 

- 0.01 

0.39 

0.97 

50608 

- 2.07 

50 

43 

0.45 

0.70 

- 1.19 

0.37 

- 1.08 

- 0.01 

0.58 

1.32 

50609 

- 3.58 

53 

51 

0.76 

0.97 

0.16 

0.38 

- 0.30 

- 0.01 

0.28 

1.07 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50610 

- 2.07 

50 

44 

0.48 

0.72 

- 0.95 

0.40 

- 0.74 

- 0.01 

0.48 

1.27 

50611 

- 1.39 

265 

243 

0.24 

1.03 

0.23 

0.86 

- 0.26 

0.00 

0.27 

0.99 

50612 

- 1.55 

58 

48 

0.38 

1.03 

0.19 

0.78 

- 0.34 

- 0.01 

0.34 

1.02 

50613 

- 0.44 

54 

35 

0.32 

1.15 

1.11 

1.13 

0.56 

- 0.01 

0.35 

0.68 

50614 

- 2.62 

53 

49 

0.60 

1.04 

0.25 

0.82 

0.15 

- 0.01 

0.38 

0.98 

50615 

- 0.09 

51 

30 

0.32 

0.96 

- 0.33 

0.96 

- 0.05 

- 0.01 

0.44 

1.09 

50616 

- 1.03 

50 

40 

0.38 

0.72 

- 1.46 

0.53 

- 1.46 

- 0.01 

0.56 

1.40 

50617 

- 1.25 

52 

39 

0.37 

0.77 

- 1.28 

0.55 

- 1.34 

- 0.01 

0.61 

1.37 

50618 

- 2.71 

49 

46 

0.61 

1.02 

0.21 

0.96 

0.20 

- 0.01 

0.18 

0.98 

50619 

- 2.18 

49 

43 

0.46 

0.94 

- 0.13 

0.83 

- 0.10 

- 0.01 

0.31 

1.07 

50620 

- 0.98 

51 

38 

0.35 

0.76 

- 1.57 

0.61 

- 1.28 

- 0.01 

0.56 

1.43 

50621 

- 1.54 

53 

44 

0.39 

0.86 

- 0.59 

0.53 

- 0.81 

- 0.01 

0.47 

1.22 

50622 

- 0.89 

52 

39 

0.36 

0.80 

- 1.11 

0.64 

- 1.18 

- 0.01 

0.55 

1.31 

50623 

- 0.39 

50 

30 

0.33 

0.89 

- 0.83 

0.77 

- 1.01 

- 0.01 

0.56 

1.30 

50624 

- 0.28 

51 

33 

0.33 

0.93 

- 0.39 

0.99 

0.04 

- 0.01 

0.50 

1.09 

50625 

- 0.75 

53 

37 

0.35 

0.79 

- 1.32 

0.70 

- 0.86 

- 0.01 

0.60 

1.34 

50626 

- 1.04 

52 

41 

0.38 

0.94 

- 0.23 

0.67 

- 0.58 

- 0.01 

0.47 

1.14 

50627 

0.05 

50 

29 

0.32 

1.04 

0.34 

1.39 

1.86 

- 0.01 

0.37 

0.78 

50628 

0.20 

53 

31 

0.30 

0.86 

- 1.45 

0.82 

- 1.18 

- 0.01 

0.51 

1.51 

50629 

1.07 

49 

20 

0.33 

1.03 

0.23 

0.93 

- 0.25 

- 0.01 

0.48 

0.99 

50630 

0.14 

52 

29 

0.33 

0.96 

- 0.25 

0.84 

- 0.58 

- 0.01 

0.55 

1.13 

50631 

0.50 

50 

23 

0.32 

0.74 

- 2.14 

0.67 

- 1.97 

- 0.01 

0.66 

1.67 

50632 

0.13 

49 

27 

0.33 

0.95 

- 0.34 

0.86 

- 0.70 

- 0.01 

0.50 

1.18 

50633 

0.75 

51 

23 

0.32 

0.94 

- 0.45 

0.85 

- 0.72 

- 0.01 

0.52 

1.20 

50634 

0.10 

50 

28 

0.33 

0.68 

- 2.58 

0.57 

- 1.90 

- 0.01 

0.67 

1.74 

50635 

0.56 

51 

26 

0.31 

0.99 

- 0.03 

0.93 

- 0.34 

- 0.01 

0.45 

1.06 

50636 

0.03 

53 

33 

0.32 

0.92 

- 0.58 

0.80 

- 0.81 

- 0.01 

0.50 

1.24 

50637 

- 0.37 

49 

30 

0.34 

1.01 

0.12 

0.97 

- 0.03 

- 0.01 

0.47 

0.99 

50638 

- 0.12 

51 

31 

0.33 

0.91 

- 0.71 

0.81 

- 0.68 

- 0.01 

0.53 

1.25 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50639 

0.21 

49 

26 

0.33 

0.85 

- 1.09 

0.92 

- 0.30 

- 0.01 

0.58 

1.29 

50640 

1.28 

50 

17 

0.33 

0.77 

- 1.63 

0.90 

- 0.40 

- 0.01 

0.60 

1.39 

50641 

- 0.46 

52 

34 

0.33 

1.11 

0.83 

1.00 

0.11 

- 0.01 

0.37 

0.80 

50642 

0.25 

49 

27 

0.34 

1.20 

1.39 

1.32 

1.31 

- 0.01 

0.38 

0.49 

50643 

- 0.14 

49 

30 

0.32 

1.25 

1.91 

1.23 

1.05 

- 0.01 

0.22 

0.37 

50644 

0.00 

56 

36 

0.31 

1.26 

1.95 

1.36 

1.57 

- 0.01 

0.24 

0.35 

50645 

- 2.13 

54 

48 

0.47 

0.85 

- 0.40 

0.47 

- 0.72 

- 0.01 

0.48 

1.16 

50646 

- 1.59 

50 

42 

0.41 

0.98 

0.01 

0.86 

- 0.15 

- 0.01 

0.34 

1.03 

50647 

- 1.26 

54 

45 

0.39 

0.87 

- 0.49 

0.94 

0.00 

- 0.01 

0.43 

1.11 

50648 

- 1.14 

52 

40 

0.37 

1.03 

0.23 

0.88 

- 0.15 

- 0.01 

0.42 

0.99 

50649 

- 0.40 

53 

35 

0.32 

0.85 

- 1.03 

0.71 

- 1.34 

- 0.01 

0.58 

1.35 

50650 

- 1.02 

52 

41 

0.37 

0.86 

- 0.62 

0.69 

- 0.82 

- 0.01 

0.51 

1.20 

50651 

0.48 

50 

21 

0.32 

1.50 

3.51 

2.18 

4.03 

- 0.01 

0.03 

- 0.51 

50652 

1.21 

51 

20 

0.34 

0.91 

- 0.56 

0.97 

- 0.05 

- 0.01 

0.58 

1.14 

50653 

0.49 

51 

24 

0.32 

1.30 

2.04 

1.23 

0.98 

- 0.01 

0.31 

0.39 

50654 

2.20 

51 

13 

0.38 

1.28 

1.37 

2.60 

2.67 

0.00 

0.28 

0.41 

50655 

2.23 

49 

8 

0.42 

1.06 

0.32 

1.52 

1.17 

- 0.01 

0.26 

0.88 

50656 

1.51 

53 

11 

0.36 

1.14 

0.73 

1.40 

1.05 

- 0.01 

0.16 

0.76 

50657 

1.45 

50 

14 

0.37 

1.05 

0.33 

1.09 

0.35 

- 0.01 

0.46 

0.91 

50658 

2.29 

50 

9 

0.41 

1.02 

0.15 

1.89 

1.47 

- 0.01 

0.30 

0.86 

50659 

3.99 

50 

3 

0.73 

0.97 

0.16 

1.82 

1.01 

- 0.01 

0.42 

0.97 

50660 

2.10 

50 

11 

0.40 

1.11 

0.54 

2.79 

2.81 

- 0.01 

0.31 

0.64 

50661 

- 1.25 

52 

41 

0.36 

0.93 

- 0.31 

0.98 

0.04 

- 0.01 

0.36 

1.07 

50662 

- 1.32 

52 

42 

0.39 

0.95 

- 0.16 

1.10 

0.35 

- 0.01 

0.37 

1.02 

50663 

- 2.31 

48 

43 

0.51 

0.87 

- 0.28 

0.74 

- 0.19 

- 0.01 

0.40 

1.09 

50664 

0.17 

51 

26 

0.32 

1.17 

1.29 

1.97 

3.18 

- 0.01 

0.32 

0.31 

50665 

- 1.14 

52 

42 

0.37 

0.93 

- 0.30 

0.83 

- 0.31 

- 0.01 

0.34 

1.11 

50666 

- 2.29 

49 

45 

0.55 

0.81 

- 0.37 

0.45 

- 0.60 

- 0.01 

0.37 

1.16 

50667 

0.26 

53 

27 

0.30 

0.99 

- 0.04 

0.98 

- 0.07 

- 0.01 

0.44 

1.03 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50668 

- 0.67 

50 

35 

0.34 

0.82 

- 1.23 

0.66 

- 1.33 

- 0.01 

0.59 

1.38 

50669 

- 0.40 

47 

29 

0.34 

0.77 

- 1.68 

0.64 

- 1.66 

- 0.01 

0.64 

1.54 

50670 

- 0.57 

48 

30 

0.34 

0.94 

- 0.35 

0.80 

- 0.63 

- 0.01 

0.54 

1.16 

50671 

0.66 

51 

23 

0.31 

1.07 

0.58 

1.05 

0.35 

- 0.01 

0.38 

0.83 

50672 

0.44 

50 

24 

0.30 

0.88 

- 1.34 

0.88 

- 1.04 

- 0.01 

0.49 

1.53 

50673 

1.17 

281 

144 

0.14 

0.93 

- 1.31 

0.87 

- 1.47 

0.00 

0.51 

1.20 

50674 

2.00 

51 

10 

0.39 

1.02 

0.15 

1.15 

0.52 

- 0.01 

0.39 

0.95 

50675 

1.36 

52 

18 

0.33 

1.02 

0.16 

1.11 

0.49 

- 0.01 

0.45 

0.94 

50676 

1.48 

49 

15 

0.35 

1.40 

2.21 

1.94 

2.69 

- 0.01 

0.09 

0.17 

50677 

- 0.78 

49 

35 

0.34 

1.11 

0.76 

1.10 

0.47 

- 0.01 

0.22 

0.78 

50678 

0.44 

48 

25 

0.32 

1.03 

0.29 

1.00 

0.06 

- 0.01 

0.43 

0.93 

50679 

1.66 

49 

12 

0.37 

1.12 

0.67 

1.18 

0.65 

- 0.01 

0.30 

0.82 

50680 

- 0.13 

49 

30 

0.34 

0.97 

- 0.16 

0.90 

- 0.33 

- 0.01 

0.51 

1.09 

50681 

- 0.45 

50 

35 

0.36 

0.89 

- 0.65 

0.73 

- 0.61 

- 0.01 

0.54 

1.22 

50682 

2.31 

48 

11 

0.38 

1.31 

1.45 

1.98 

2.11 

- 0.01 

0.11 

0.47 

50683 

1.15 

49 

16 

0.34 

1.05 

0.39 

1.33 

1.47 

- 0.01 

0.33 

0.80 

50684 

1.09 

50 

19 

0.33 

0.97 

- 0.16 

1.02 

0.18 

- 0.01 

0.46 

1.02 

50685 

1.83 

48 

13 

0.38 

1.27 

1.34 

1.49 

1.28 

- 0.01 

0.29 

0.57 

50686 

0.60 

56 

28 

0.31 

1.29 

2.09 

1.27 

1.27 

- 0.01 

0.33 

0.37 

50687 

0.13 

56 

30 

0.31 

1.24 

1.93 

1.36 

1.33 

- 0.01 

0.33 

0.32 

50688 

- 0.14 

55 

34 

0.30 

1.14 

1.24 

1.12 

0.66 

- 0.01 

0.29 

0.62 

50689 

0.88 

49 

19 

0.33 

1.19 

1.27 

1.21 

0.96 

- 0.01 

0.32 

0.60 

50690 

0.51 

50 

25 

0.34 

1.17 

1.15 

1.13 

0.46 

- 0.01 

0.46 

0.68 

50691 

- 0.48 

53 

36 

0.33 

0.99 

- 0.01 

1.21 

0.76 

- 0.01 

0.43 

0.94 

50692 

0.38 

52 

28 

0.31 

0.96 

- 0.32 

0.92 

- 0.49 

- 0.01 

0.46 

1.15 

50693 

- 0.96 

52 

40 

0.36 

0.87 

- 0.69 

0.82 

- 0.41 

- 0.01 

0.47 

1.18 

50694 

- 0.04 

50 

29 

0.32 

1.35 

2.60 

1.51 

2.24 

- 0.01 

0.13 

0.00 

50695 

2.96 

50 

6 

0.49 

1.21 

0.72 

0.85 

0.04 

- 0.01 

0.32 

0.89 

50696 

- 0.47 

50 

33 

0.33 

0.93 

- 0.52 

0.83 

- 0.56 

- 0.01 

0.47 

1.20 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50697 

- 0.01 

50 

30 

0.33 

0.88 

- 0.91 

0.73 

- 1.10 

- 0.01 

0.57 

1.34 

50698 

0.73 

50 

23 

0.31 

0.87 

- 1.24 

0.90 

- 0.68 

- 0.01 

0.51 

1.41 

50699 

1.31 

50 

19 

0.34 

1.22 

1.41 

1.36 

1.22 

- 0.01 

0.39 

0.54 

50700 

0.73 

53 

23 

0.32 

0.99 

- 0.03 

0.98 

- 0.04 

- 0.01 

0.50 

1.02 

50701 

0.91 

50 

18 

0.33 

1.06 

0.49 

1.20 

0.98 

- 0.01 

0.37 

0.80 

50702 

- 0.66 

50 

39 

0.37 

0.90 

- 0.47 

0.94 

- 0.05 

- 0.01 

0.43 

1.12 

50703 

0.00 

49 

49 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

50704 

0.40 

52 

27 

0.32 

1.31 

2.33 

1.55 

2.49 

- 0.01 

0.23 

0.08 

50705 

- 0.69 

49 

37 

0.38 

0.88 

- 0.56 

0.73 

- 0.61 

- 0.01 

0.53 

1.18 

50706 

1.57 

50 

15 

0.35 

0.99 

0.02 

0.93 

- 0.21 

- 0.01 

0.46 

1.03 

50707 

1.09 

50 

20 

0.33 

1.45 

2.67 

1.48 

1.89 

- 0.01 

0.21 

0.16 

50708 

0.00 

49 

49 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

50709 

- 1.36 

49 

39 

0.38 

1.28 

1.31 

1.55 

1.17 

- 0.01 

0.10 

0.58 

50710 

0.24 

49 

28 

0.32 

1.16 

1.24 

1.16 

0.95 

- 0.01 

0.31 

0.58 

50711 

- 1.93 

50 

44 

0.47 

1.25 

0.84 

1.27 

0.62 

- 0.01 

0.14 

0.80 

50712 

- 2.57 

50 

46 

0.54 

0.88 

- 0.18 

0.57 

- 0.37 

- 0.01 

0.36 

1.11 

50713 

0.45 

50 

23 

0.33 

1.04 

0.35 

1.01 

0.12 

- 0.01 

0.48 

0.93 

50714 

- 2.46 

49 

44 

0.49 

0.97 

0.03 

0.94 

0.14 

- 0.01 

0.27 

1.00 

50715 

- 2.74 

50 

45 

0.54 

1.22 

0.66 

1.03 

0.31 

- 0.01 

0.31 

0.89 

50716 

- 1.72 

49 

40 

0.42 

1.14 

0.66 

2.57 

2.17 

- 0.01 

0.27 

0.69 

50717 

- 2.24 

48 

44 

0.55 

0.87 

- 0.20 

0.70 

- 0.20 

- 0.01 

0.35 

1.08 

50718 

- 3.20 

48 

46 

0.74 

1.03 

0.25 

0.58 

0.01 

- 0.01 

0.21 

1.01 

50719 

0.00 

50 

50 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

50720 

- 3.31 

50 

48 

0.74 

0.89 

0.02 

0.32 

- 0.40 

- 0.01 

0.30 

1.10 

50721 

- 2.87 

48 

45 

0.62 

0.91 

- 0.04 

1.26 

0.57 

- 0.01 

0.23 

1.01 

50722 

- 2.79 

50 

47 

0.61 

1.03 

0.23 

1.58 

0.88 

- 0.01 

0.12 

0.93 

50723 

- 2.87 

48 

45 

0.62 

0.84 

- 0.20 

0.62 

- 0.17 

- 0.01 

0.35 

1.09 

50724 

- 4.60 

48 

47 

1.07 

1.21 

0.52 

0.73 

0.26 

- 0.01 

0.13 

0.93 

50725 

- 3.20 

49 

46 

0.61 

0.94 

0.03 

0.63 

- 0.13 

- 0.01 

0.26 

1.05 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50726 

- 3.63 

49 

47 

0.76 

1.22 

0.54 

0.94 

0.36 

- 0.01 

0.13 

0.89 

50727 

- 2.41 

48 

45 

0.61 

0.90 

- 0.05 

0.47 

- 0.33 

- 0.01 

0.31 

1.10 

50728 

- 1.96 

49 

43 

0.48 

1.01 

0.14 

0.70 

- 0.33 

- 0.01 

0.41 

1.04 

50729 

- 0.11 

48 

30 

0.33 

1.03 

0.27 

0.98 

0.01 

- 0.01 

0.39 

0.94 

50730 

- 0.61 

49 

35 

0.35 

0.83 

- 1.10 

0.71 

- 1.08 

- 0.01 

0.52 

1.35 

50731 

- 1.17 

47 

37 

0.39 

0.97 

- 0.09 

2.09 

2.26 

- 0.01 

0.32 

0.93 

50732 

- 1.51 

49 

38 

0.38 

1.01 

0.11 

0.86 

- 0.17 

- 0.01 

0.42 

1.01 

50733 

0.22 

48 

26 

0.32 

1.04 

0.38 

1.00 

0.07 

- 0.01 

0.42 

0.92 

50734 

- 0.75 

49 

35 

0.35 

0.96 

- 0.22 

0.98 

0.05 

- 0.01 

0.44 

1.05 

50735 

- 0.90 

48 

34 

0.35 

1.16 

1.10 

1.14 

0.53 

- 0.01 

0.26 

0.66 

50736 

- 3.76 

48 

46 

0.75 

0.97 

0.16 

0.34 

- 0.48 

- 0.01 

0.32 

1.08 

50737 

2.96 

47 

5 

0.50 

0.96 

0.00 

0.76 

- 0.11 

- 0.01 

0.33 

1.04 

50738 

- 0.73 

48 

33 

0.36 

0.88 

- 0.66 

0.74 

- 0.75 

- 0.01 

0.58 

1.22 

50739 

- 2.19 

49 

43 

0.47 

0.92 

- 0.18 

0.64 

- 0.37 

- 0.01 

0.40 

1.10 

50740 

- 1.40 

48 

38 

0.40 

1.19 

0.87 

1.35 

0.80 

- 0.01 

0.27 

0.74 

50741 

- 0.79 

48 

33 

0.35 

1.03 

0.23 

0.89 

- 0.20 

- 0.01 

0.42 

0.99 

50742 

- 1.89 

49 

42 

0.45 

1.19 

0.69 

1.59 

1.09 

- 0.01 

0.23 

0.81 

50743 

- 1.70 

49 

42 

0.43 

1.14 

0.59 

1.28 

0.68 

- 0.01 

0.15 

0.84 

50744 

0.57 

48 

22 

0.32 

0.91 

- 0.76 

0.87 

- 0.90 

- 0.01 

0.50 

1.31 

50745 

- 0.09 

49 

29 

0.32 

0.97 

- 0.23 

0.95 

- 0.22 

- 0.01 

0.43 

1.10 

50746 

0.11 

49 

27 

0.33 

0.82 

- 1.45 

0.77 

- 1.02 

- 0.01 

0.59 

1.45 

50747 

- 0.74 

50 

34 

0.34 

1.19 

1.17 

1.07 

0.31 

- 0.01 

0.35 

0.71 

50748 

- 0.68 

49 

35 

0.35 

0.92 

- 0.42 

0.78 

- 0.64 

- 0.01 

0.51 

1.17 

50749 

- 0.71 

49 

36 

0.36 

0.98 

- 0.08 

0.86 

- 0.32 

- 0.01 

0.42 

1.06 

50750 

2.40 

49 

8 

0.41 

1.13 

0.57 

1.08 

0.33 

- 0.01 

0.22 

0.89 

50751 

1.73 

48 

12 

0.39 

1.42 

1.88 

1.54 

1.19 

- 0.01 

0.24 

0.44 

50752 

2.09 

49 

10 

0.38 

1.16 

0.77 

1.45 

1.22 

- 0.01 

0.21 

0.78 

50753 

2.11 

49 

10 

0.40 

1.36 

1.50 

2.22 

2.08 

- 0.01 

0.15 

0.44 

50754 

1.39 

48 

16 

0.34 

1.24 

1.50 

1.20 

0.71 

- 0.01 

0.27 

0.55 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50755 

2.20 

49 

11 

0.42 

1.34 

1.39 

2.25 

1.75 

- 0.01 

0.34 

0.48 

50756 

1.51 

48 

14 

0.36 

0.79 

- 1.28 

0.61 

- 1.23 

- 0.01 

0.61 

1.38 

50757 

3.06 

48 

6 

0.51 

1.18 

0.61 

2.76 

1.72 

- 0.01 

0.32 

0.75 

50758 

0.44 

49 

24 

0.32 

0.95 

- 0.34 

0.95 

- 0.25 

- 0.01 

0.43 

1.13 

50759 

0.40 

48 

22 

0.32 

0.98 

- 0.15 

0.92 

- 0.45 

- 0.01 

0.45 

1.11 

50760 

2.94 

48 

5 

0.50 

1.13 

0.47 

1.79 

1.22 

- 0.01 

0.09 

0.83 

50761 

- 0.29 

48 

29 

0.34 

0.73 

- 2.18 

0.62 

- 1.73 

- 0.01 

0.63 

1.70 

50762 

0.59 

48 

22 

0.34 

0.76 

- 1.72 

1.02 

0.15 

- 0.01 

0.64 

1.40 

50763 

- 0.84 

51 

37 

0.34 

0.86 

- 0.85 

1.22 

0.70 

- 0.01 

0.46 

1.15 

50764 

- 0.40 

49 

32 

0.35 

0.86 

- 0.85 

0.87 

- 0.41 

- 0.01 

0.57 

1.24 

50765 

- 0.35 

48 

29 

0.33 

0.75 

- 2.04 

0.66 

- 1.62 

- 0.01 

0.64 

1.62 

50766 

- 0.91 

47 

34 

0.37 

0.76 

- 1.37 

0.54 

- 1.28 

- 0.01 

0.64 

1.41 

50767 

- 0.62 

49 

33 

0.33 

0.78 

- 1.68 

0.66 

- 1.32 

- 0.01 

0.58 

1.52 

50768 

- 1.17 

49 

37 

0.37 

1.05 

0.33 

0.96 

0.02 

- 0.01 

0.41 

0.95 

50769 

- 0.55 

49 

33 

0.35 

0.80 

- 1.26 

0.90 

- 0.25 

- 0.01 

0.58 

1.30 

50770 

0.79 

48 

19 

0.34 

0.85 

- 0.98 

0.73 

- 1.18 

- 0.01 

0.60 

1.33 

50771 

- 1.39 

48 

37 

0.38 

1.01 

0.10 

0.86 

- 0.21 

- 0.01 

0.38 

1.02 

50772 

- 0.70 

49 

32 

0.34 

1.04 

0.32 

0.99 

0.06 

- 0.01 

0.42 

0.94 

50773 

- 1.49 

49 

40 

0.40 

0.98 

0.00 

0.75 

- 0.38 

- 0.01 

0.42 

1.06 

50774 

- 2.16 

48 

42 

0.46 

0.85 

- 0.39 

0.75 

- 0.23 

- 0.01 

0.39 

1.11 

50775 

1.12 

49 

17 

0.34 

0.99 

- 0.04 

1.50 

1.77 

- 0.01 

0.40 

0.83 

50776 

1.26 

48 

16 

0.33 

1.03 

0.28 

1.04 

0.29 

- 0.01 

0.33 

0.93 

50777 

0.30 

53 

28 

0.31 

0.93 

- 0.54 

0.97 

- 0.11 

- 0.01 

0.49 

1.15 

50778 

1.59 

48 

14 

0.37 

1.04 

0.25 

0.93 

- 0.07 

0.00 

0.49 

0.97 

50779 

0.68 

53 

23 

0.31 

0.94 

- 0.46 

0.89 

- 0.59 

- 0.01 

0.51 

1.18 

50780 

0.32 

49 

24 

0.33 

0.95 

- 0.37 

1.05 

0.31 

- 0.01 

0.49 

1.06 

50781 

0.68 

49 

27 

0.32 

0.98 

- 0.12 

0.95 

- 0.20 

- 0.01 

0.45 

1.07 

50782 

- 0.48 

48 

28 

0.33 

1.03 

0.26 

0.91 

- 0.33 

- 0.01 

0.45 

1.00 

50783 

- 0.66 

49 

31 

0.33 

0.98 

- 0.08 

0.88 

- 0.34 

- 0.01 

0.47 

1.08 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50784 

- 0.81 

48 

35 

0.36 

0.82 

- 1.13 

0.64 

- 1.06 

- 0.01 

0.52 

1.37 

50785 

- 0.46 

49 

31 

0.33 

0.72 

- 2.27 

0.59 

- 1.85 

- 0.01 

0.66 

1.67 

50786 

0.42 

273 

197 

0.15 

0.85 

- 2.21 

0.71 

- 1.92 

0.00 

0.54 

1.28 

50787 

0.66 

49 

23 

0.32 

0.73 

- 2.51 

0.66 

- 2.03 

- 0.01 

0.66 

1.83 

50788 

0.55 

49 

20 

0.33 

0.89 

- 0.70 

0.77 

- 1.05 

- 0.01 

0.57 

1.27 

50789 

1.17 

49 

16 

0.33 

1.11 

0.80 

1.35 

1.22 

- 0.01 

0.25 

0.68 

50790 

- 0.43 

48 

28 

0.33 

0.84 

- 1.22 

0.72 

- 1.27 

- 0.01 

0.57 

1.46 

50791 

- 1.39 

53 

43 

0.39 

0.94 

- 0.19 

0.94 

0.02 

- 0.01 

0.45 

1.06 

50792 

- 0.71 

48 

34 

0.35 

0.97 

- 0.18 

0.84 

- 0.40 

- 0.01 

0.42 

1.10 

50793 

- 0.67 

49 

34 

0.35 

1.04 

0.28 

0.95 

- 0.03 

- 0.01 

0.42 

0.96 

50794 

- 0.96 

48 

35 

0.37 

1.12 

0.70 

1.03 

0.19 

- 0.01 

0.37 

0.85 

50795 

- 0.59 

48 

31 

0.35 

0.67 

- 2.47 

0.53 

- 1.71 

- 0.01 

0.68 

1.68 

50796 

- 0.03 

49 

30 

0.33 

0.92 

- 0.58 

1.06 

0.34 

- 0.01 

0.46 

1.11 

50797 

- 1.01 

48 

35 

0.37 

0.88 

- 0.63 

0.66 

- 0.90 

- 0.01 

0.57 

1.23 

50798 

0.16 

48 

26 

0.32 

1.00 

0.07 

0.95 

- 0.17 

- 0.01 

0.44 

1.01 

50799 

- 0.67 

49 

32 

0.34 

0.97 

- 0.15 

0.81 

- 0.53 

- 0.01 

0.49 

1.12 

50800 

- 0.78 

52 

37 

0.34 

1.06 

0.47 

0.96 

- 0.04 

- 0.01 

0.38 

0.91 

50801 

2.04 

48 

9 

0.42 

0.96 

- 0.05 

2.00 

1.92 

- 0.01 

0.37 

0.88 

50802 

0.96 

48 

16 

0.34 

1.04 

0.34 

1.49 

1.59 

- 0.01 

0.36 

0.78 

50803 

0.71 

49 

20 

0.34 

1.18 

1.21 

1.15 

0.55 

- 0.01 

0.39 

0.65 

50804 

0.63 

51 

26 

0.32 

0.99 

- 0.01 

0.92 

- 0.35 

- 0.01 

0.48 

1.06 

50805 

0.65 

49 

24 

0.32 

1.18 

1.54 

1.32 

1.66 

- 0.01 

0.28 

0.36 

50806 

2.00 

47 

8 

0.42 

1.08 

0.40 

1.99 

1.92 

- 0.01 

0.13 

0.77 

50807 

1.06 

48 

18 

0.34 

0.79 

- 1.38 

0.80 

- 0.86 

- 0.01 

0.62 

1.38 

50808 

0.51 

253 

167 

0.15 

0.88 

- 2.06 

0.75 

- 2.26 

0.00 

0.53 

1.31 

50809 

1.04 

47 

17 

0.36 

0.90 

- 0.59 

0.81 

- 0.70 

- 0.01 

0.59 

1.20 

50810 

1.18 

49 

19 

0.33 

1.08 

0.66 

1.15 

0.80 

- 0.01 

0.35 

0.75 

50811 

- 2.60 

49 

46 

0.61 

0.79 

- 0.30 

0.32 

- 0.64 

- 0.01 

0.38 

1.16 

50812 

- 2.29 

49 

43 

0.47 

0.94 

- 0.11 

0.61 

- 0.38 

- 0.01 

0.37 

1.09 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50813 

- 1.59 

49 

40 

0.40 

0.65 

- 1.77 

0.42 

- 1.19 

- 0.01 

0.55 

1.45 

50814 

- 1.66 

50 

44 

0.46 

0.89 

- 0.30 

0.54 

- 0.57 

- 0.01 

0.41 

1.14 

50815 

- 2.04 

49 

43 

0.47 

0.91 

- 0.24 

0.65 

- 0.29 

- 0.01 

0.40 

1.10 

50816 

- 0.15 

48 

30 

0.33 

1.00 

0.03 

0.95 

- 0.11 

- 0.01 

0.44 

1.02 

50817 

- 1.87 

48 

42 

0.47 

0.78 

- 0.73 

0.52 

- 0.66 

- 0.01 

0.46 

1.21 

50818 

- 2.17 

46 

41 

0.50 

0.97 

0.04 

0.85 

0.01 

- 0.01 

0.30 

1.04 

50819 

- 2.74 

48 

45 

0.63 

0.82 

- 0.25 

0.37 

- 0.50 

- 0.01 

0.42 

1.14 

50820 

- 0.61 

49 

37 

0.36 

1.06 

0.36 

1.10 

0.41 

- 0.01 

0.31 

0.90 

50821 

- 1.79 

48 

42 

0.46 

1.01 

0.15 

1.13 

0.41 

- 0.01 

0.26 

0.96 

50822 

- 1.89 

48 

42 

0.45 

1.03 

0.19 

1.29 

0.66 

- 0.01 

0.14 

0.93 

50823 

- 2.24 

50 

44 

0.45 

0.97 

0.00 

1.07 

0.31 

- 0.01 

0.25 

1.00 

50824 

- 0.27 

49 

32 

0.32 

0.99 

- 0.04 

1.22 

1.09 

- 0.01 

0.33 

0.92 

50825 

- 1.74 

49 

43 

0.47 

1.00 

0.09 

0.86 

0.02 

- 0.01 

0.33 

1.03 

50826 

2.37 

278 

96 

0.14 

1.00 

0.05 

1.13 

1.10 

0.00 

0.40 

0.95 

50827 

- 0.74 

48 

35 

0.36 

0.98 

- 0.06 

0.87 

- 0.23 

- 0.01 

0.42 

1.05 

50828 

- 0.35 

47 

30 

0.35 

0.87 

- 0.89 

0.95 

- 0.17 

- 0.01 

0.51 

1.22 

50829 

0.13 

47 

26 

0.33 

1.28 

2.13 

1.65 

2.73 

- 0.01 

0.17 

0.05 

50830 

- 0.57 

48 

33 

0.35 

0.76 

- 1.67 

0.63 

- 1.11 

- 0.01 

0.61 

1.47 

50831 

- 0.69 

49 

33 

0.34 

0.82 

- 1.13 

0.75 

- 1.25 

- 0.01 

0.55 

1.35 

50832 

- 1.32 

49 

41 

0.43 

0.85 

- 0.52 

0.67 

- 0.68 

- 0.01 

0.47 

1.17 

50833 

0.96 

48 

20 

0.34 

0.86 

- 1.01 

0.76 

- 1.08 

- 0.01 

0.59 

1.35 

50834 

0.00 

49 

30 

0.33 

0.95 

- 0.34 

0.83 

- 0.71 

- 0.01 

0.50 

1.18 

50835 

- 0.92 

49 

35 

0.35 

0.91 

- 0.55 

0.85 

- 0.49 

- 0.01 

0.44 

1.18 

50836 

- 1.20 

49 

39 

0.40 

1.06 

0.33 

1.23 

0.59 

- 0.01 

0.39 

0.92 

50837 

- 0.01 

267 

200 

0.15 

1.05 

0.62 

1.11 

0.72 

0.00 

0.34 

0.91 

50838 

- 1.60 

275 

259 

0.27 

0.92 

- 0.32 

0.61 

- 1.11 

0.00 

0.34 

1.08 

50839 

- 2.07 

49 

42 

0.45 

1.05 

0.28 

0.87 

- 0.10 

- 0.01 

0.37 

0.98 

50840 

- 1.95 

48 

41 

0.45 

1.06 

0.29 

1.07 

0.32 

- 0.01 

0.33 

0.94 

50841 

- 1.67 

48 

38 

0.40 

0.79 

- 0.94 

0.57 

- 0.78 

- 0.01 

0.57 

1.27 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50842 

2.83 

49 

8 

0.44 

1.28 

1.09 

1.83 

1.27 

- 0.01 

0.22 

0.63 

50843 

2.20 

49 

10 

0.39 

1.23 

1.06 

2.91 

3.19 

- 0.01 

0.11 

0.50 

50844 

- 2.55 

49 

45 

0.55 

0.87 

- 0.19 

1.49 

0.83 

- 0.01 

0.31 

1.03 

50845 

- 1.88 

50 

44 

0.47 

1.04 

0.24 

2.12 

1.74 

- 0.01 

0.24 

0.89 

50846 

- 2.51 

49 

45 

0.61 

0.93 

0.01 

0.54 

- 0.43 

- 0.01 

0.50 

1.08 

50847 

- 2.07 

48 

42 

0.47 

0.98 

0.03 

1.11 

0.37 

- 0.01 

0.31 

0.99 

50848 

- 0.38 

51 

34 

0.32 

1.08 

0.61 

1.11 

0.53 

- 0.01 

0.32 

0.79 

50849 

- 0.59 

48 

34 

0.35 

1.18 

1.09 

1.20 

0.77 

- 0.01 

0.27 

0.68 

50850 

1.64 

49 

13 

0.37 

1.16 

0.83 

1.23 

0.81 

- 0.01 

0.34 

0.78 

50851 

- 1.67 

47 

41 

0.46 

0.93 

- 0.13 

0.82 

- 0.28 

- 0.01 

0.31 

1.07 

50852 

- 1.64 

48 

39 

0.40 

1.10 

0.50 

0.93 

- 0.03 

- 0.01 

0.28 

0.92 

50853 

- 2.67 

48 

43 

0.55 

0.86 

- 0.30 

0.45 

- 0.31 

- 0.01 

0.51 

1.13 

50854 

- 2.75 

48 

44 

0.54 

1.08 

0.32 

1.16 

0.45 

- 0.01 

0.16 

0.93 

50855 

- 1.74 

49 

42 

0.44 

0.84 

- 0.48 

0.76 

- 0.30 

- 0.01 

0.42 

1.13 

50856 

0.00 

49 

49 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

50857 

- 3.16 

49 

46 

0.68 

0.98 

0.14 

1.30 

0.61 

- 0.01 

0.32 

0.94 

50858 

- 0.74 

49 

36 

0.35 

1.02 

0.21 

1.15 

0.61 

- 0.01 

0.31 

0.93 

50859 

0.12 

49 

26 

0.33 

1.00 

0.07 

0.95 

- 0.11 

- 0.01 

0.46 

1.01 

50860 

- 0.74 

49 

34 

0.34 

0.83 

- 1.16 

0.81 

- 0.59 

- 0.01 

0.52 

1.31 

50861 

0.39 

49 

23 

0.32 

1.12 

0.96 

1.09 

0.37 

- 0.01 

0.38 

0.68 

50862 

- 0.29 

49 

33 

0.35 

0.94 

- 0.32 

1.45 

1.37 

- 0.01 

0.46 

0.96 

50863 

- 0.35 

51 

35 

0.32 

1.10 

0.85 

1.05 

0.33 

- 0.01 

0.25 

0.76 

50864 

- 0.88 

49 

36 

0.35 

1.14 

0.87 

1.04 

0.24 

- 0.01 

0.28 

0.79 

50865 

- 1.37 

49 

39 

0.38 

0.98 

- 0.02 

0.78 

- 0.30 

- 0.01 

0.37 

1.06 

50866 

- 0.49 

49 

31 

0.33 

0.95 

- 0.35 

0.90 

- 0.36 

- 0.01 

0.43 

1.14 

50867 

- 2.65 

48 

45 

0.61 

1.08 

0.31 

1.28 

0.59 

- 0.01 

0.11 

0.92 

50868 

- 1.95 

49 

41 

0.45 

0.83 

- 0.53 

0.69 

- 0.47 

- 0.01 

0.57 

1.16 

50869 

- 1.06 

49 

39 

0.38 

0.98 

- 0.04 

0.76 

- 0.63 

- 0.01 

0.39 

1.08 

50870 

- 3.77 

48 

47 

1.03 

0.95 

0.25 

0.26 

- 0.30 

- 0.01 

0.26 

1.07 



easyCBM CCSS Fifth Grade Math Measure Development 


194 

Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50871 

- 0.23 

48 

28 

0.32 

0.95 

- 0.45 

0.98 

0.01 

- 0.01 

0.42 

1.12 

50872 

- 0.68 

48 

34 

0.35 

0.88 

- 0.74 

0.80 

- 0.60 

- 0.01 

0.50 

1.23 

50873 

2.77 

48 

6 

0.46 

1.16 

0.60 

1.48 

0.93 

- 0.01 

0.12 

0.80 

50874 

- 1.72 

266 

246 

0.25 

0.95 

- 0.22 

0.58 

- 1.23 

0.00 

0.34 

1.07 

50875 

- 1.30 

49 

38 

0.41 

0.92 

- 0.29 

0.74 

- 0.38 

- 0.01 

0.55 

1.12 

50876 

- 0.06 

49 

26 

0.32 

1.16 

1.50 

1.27 

1.05 

- 0.01 

0.31 

0.37 

50877 

1.44 

49 

15 

0.34 

1.35 

2.03 

1.45 

1.65 

- 0.01 

0.13 

0.37 

50878 

- 2.02 

49 

43 

0.47 

0.86 

- 0.41 

0.52 

- 0.66 

- 0.01 

0.45 

1.16 

50879 

- 1.07 

49 

39 

0.38 

0.77 

- 1.22 

0.58 

- 0.92 

- 0.01 

0.51 

1.33 

50880 

- 1.63 

49 

43 

0.46 

0.86 

- 0.39 

0.73 

- 0.22 

- 0.01 

0.38 

1.12 

50881 

- 0.57 

49 

32 

0.35 

0.82 

- 1.08 

0.67 

- 0.96 

- 0.01 

0.62 

1.33 

50882 

- 0.25 

49 

32 

0.33 

0.76 

- 1.96 

0.71 

- 1.39 

- 0.01 

0.57 

1.60 

50883 

0.69 

54 

26 

0.31 

1.22 

1.73 

1.23 

1.03 

- 0.01 

0.29 

0.42 

50884 

- 1.53 

49 

42 

0.44 

1.11 

0.48 

1.32 

0.71 

- 0.01 

0.22 

0.86 

50885 

- 1.11 

49 

38 

0.37 

1.00 

0.08 

0.92 

- 0.04 

- 0.01 

0.38 

1.00 

50886 

1.74 

48 

12 

0.37 

0.72 

- 1.46 

0.57 

- 1.49 

- 0.01 

0.67 

1.38 

50887 

- 3.26 

49 

47 

0.74 

0.77 

- 0.20 

0.22 

- 0.58 

- 0.01 

0.35 

1.16 

50888 

0.48 

2791 

1406 

0.04 

0.95 

- 3.02 

0.94 

- 2.06 

- 0.01 

0.50 

1.13 

50889 

0.22 

274 

207 

0.16 

0.83 

- 2.27 

0.69 

- 1.83 

0.00 

0.52 

1.26 

50890 

0.25 

49 

28 

0.35 

0.85 

- 1.05 

0.70 

- 1.17 

- 0.01 

0.62 

1.38 

50891 

- 0.79 

49 

34 

0.36 

0.73 

- 1.68 

0.59 

- 1.34 

- 0.01 

0.63 

1.47 

50892 

0.35 

49 

25 

0.32 

0.98 

- 0.16 

0.95 

- 0.24 

- 0.01 

0.47 

1.08 

50893 

- 0.06 

49 

27 

0.32 

0.91 

- 0.80 

0.87 

- 0.56 

- 0.01 

0.50 

1.29 

50894 

1.12 

49 

21 

0.35 

0.88 

- 0.77 

0.87 

- 0.20 

- 0.01 

0.56 

1.24 

50895 

- 0.23 

51 

32 

0.33 

1.19 

1.33 

1.19 

0.77 

- 0.01 

0.36 

0.58 

50896 

- 0.12 

49 

30 

0.33 

0.91 

- 0.73 

0.75 

- 0.70 

- 0.01 

0.53 

1.30 

50897 

- 0.58 

54 

40 

0.35 

1.12 

0.67 

1.15 

0.58 

- 0.01 

0.36 

0.82 

50898 

- 0.92 

48 

36 

0.36 

0.94 

- 0.32 

0.96 

0.04 

- 0.01 

0.41 

1.06 

50899 

- 0.25 

49 

30 

0.34 

1.15 

1.07 

1.20 

0.82 

- 0.01 

0.38 

0.65 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50900 

- 0.27 

49 

33 

0.34 

1.01 

0.09 

0.95 

- 0.13 

- 0.01 

0.40 

1.01 

50901 

0.54 

48 

24 

0.33 

1.10 

0.89 

1.06 

0.44 

- 0.01 

0.40 

0.71 

50902 

0.00 

49 

29 

0.32 

1.09 

0.80 

1.08 

0.44 

- 0.01 

0.33 

0.72 

50903 

- 0.42 

48 

32 

0.34 

1.05 

0.36 

1.01 

0.11 

- 0.01 

0.38 

0.92 

50904 

- 1.75 

48 

42 

0.46 

1.13 

0.53 

1.45 

0.90 

- 0.01 

0.13 

0.81 

50905 

- 0.97 

49 

38 

0.40 

1.20 

0.93 

1.45 

1.12 

- 0.01 

0.35 

0.75 

50906 

- 0.52 

52 

37 

0.34 

1.01 

0.10 

1.04 

0.25 

- 0.01 

0.39 

0.96 

50907 

- 0.55 

48 

31 

0.36 

1.05 

0.33 

0.89 

- 0.24 

- 0.01 

0.52 

0.98 

50908 

- 0.76 

49 

35 

0.35 

1.11 

0.74 

1.18 

0.74 

- 0.01 

0.30 

0.76 

50909 

- 1.76 

49 

43 

0.45 

0.81 

- 0.55 

0.70 

- 0.53 

- 0.01 

0.45 

1.16 

50910 

- 1.73 

49 

41 

0.42 

0.87 

- 0.44 

0.69 

- 0.49 

- 0.01 

0.48 

1.14 

50911 

0.03 

48 

27 

0.34 

0.71 

- 2.24 

0.62 

- 1.95 

- 0.01 

0.67 

1.67 

50912 

- 0.77 

48 

36 

0.36 

0.84 

- 0.96 

0.67 

- 0.99 

- 0.01 

0.48 

1.32 

50913 

- 0.26 

49 

33 

0.35 

1.01 

0.14 

0.94 

- 0.12 

- 0.01 

0.46 

1.00 

50914 

- 0.25 

48 

33 

0.36 

0.94 

- 0.40 

1.46 

1.30 

- 0.01 

0.46 

1.03 

50915 

- 0.36 

48 

34 

0.36 

0.77 

- 1.49 

0.63 

- 1.47 

- 0.01 

0.57 

1.45 

50916 

- 0.34 

47 

28 

0.33 

0.88 

- 0.97 

0.80 

- 0.96 

- 0.01 

0.53 

1.36 

50917 

0.38 

48 

25 

0.34 

0.77 

- 1.79 

0.73 

- 1.16 

- 0.01 

0.64 

1.53 

50918 

1.18 

49 

18 

0.34 

0.87 

- 0.80 

0.74 

- 1.16 

- 0.01 

0.59 

1.28 

50919 

1.18 

49 

17 

0.34 

1.11 

0.71 

1.17 

0.72 

- 0.01 

0.39 

0.78 

50920 

0.21 

47 

23 

0.34 

1.00 

0.04 

0.90 

- 0.37 

- 0.01 

0.50 

1.05 

50921 

0.46 

49 

24 

0.31 

1.09 

0.92 

1.15 

1.17 

- 0.01 

0.24 

0.57 

50922 

- 0.51 

49 

31 

0.33 

1.04 

0.32 

0.96 

- 0.12 

- 0.01 

0.40 

0.95 

50923 

0.02 

49 

30 

0.34 

0.78 

- 1.73 

0.68 

- 1.28 

- 0.01 

0.63 

1.50 

50924 

- 0.22 

266 

191 

0.15 

0.96 

- 0.64 

0.88 

- 1.07 

0.00 

0.40 

1.10 

50925 

0.18 

49 

27 

0.32 

1.01 

0.16 

0.97 

- 0.09 

- 0.01 

0.45 

0.98 

50926 

- 0.14 

49 

28 

0.32 

1.16 

1.34 

1.39 

2.10 

- 0.01 

0.28 

0.39 

50927 

0.42 

51 

27 

0.31 

0.82 

- 1.66 

0.73 

- 1.57 

- 0.01 

0.58 

1.59 

50928 

- 0.02 

49 

31 

0.34 

0.80 

- 1.44 

0.88 

- 0.43 

- 0.01 

0.58 

1.38 



easyCBM CCSS Fifth Grade Math Measure Development 


196 

Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50929 

1.44 

48 

16 

0.36 

0.77 

- 1.35 

0.72 

- 0.85 

- 0.01 

0.65 

1.36 

50930 

- 0.67 

49 

36 

0.37 

0.75 

- 1.35 

0.59 

- 1.09 

- 0.01 

0.62 

1.36 

50931 

- 0.71 

49 

33 

0.35 

1.03 

0.25 

0.90 

- 0.27 

- 0.01 

0.46 

0.99 

50932 

0.62 

48 

22 

0.33 

0.86 

- 1.19 

0.80 

- 0.55 

- 0.01 

0.51 

1.42 

50933 

- 0.09 

48 

27 

0.33 

0.99 

- 0.03 

0.90 

- 0.43 

- 0.01 

0.47 

1.08 

50934 

0.37 

51 

27 

0.32 

1.01 

0.12 

1.06 

0.39 

- 0.01 

0.44 

0.94 

50935 

- 0.01 

49 

29 

0.32 

1.14 

1.29 

1.24 

1.48 

- 0.01 

0.24 

0.46 

50936 

0.65 

49 

22 

0.32 

0.95 

- 0.39 

0.91 

- 0.46 

- 0.01 

0.49 

1.16 

50937 

- 0.47 

48 

29 

0.34 

1.00 

0.06 

0.90 

- 0.33 

- 0.01 

0.46 

1.04 

50938 

- 0.18 

48 

29 

0.33 

0.80 

- 1.58 

0.69 

- 1.48 

- 0.01 

0.60 

1.52 

50939 

- 0.34 

47 

30 

0.33 

1.01 

0.14 

1.02 

0.18 

- 0.01 

0.38 

0.96 

50940 

0.60 

49 

21 

0.33 

0.81 

- 1.62 

0.71 

- 0.88 

- 0.01 

0.54 

1.55 

50941 

- 2.00 

49 

41 

0.46 

1.12 

0.49 

0.95 

0.17 

- 0.01 

0.45 

0.92 

50942 

- 1.78 

49 

40 

0.43 

0.94 

- 0.17 

1.83 

1.48 

- 0.01 

0.45 

0.97 

50943 

- 0.44 

48 

36 

0.37 

1.35 

1.81 

1.44 

1.24 

- 0.01 

0.16 

0.43 

50944 

- 1.14 

50 

40 

0.38 

1.00 

0.08 

1.01 

0.16 

- 0.01 

0.34 

0.99 

50945 

- 1.15 

49 

38 

0.37 

0.90 

- 0.47 

0.75 

- 0.50 

- 0.01 

0.45 

1.16 

50946 

- 1.68 

49 

39 

0.40 

0.92 

- 0.29 

1.00 

0.16 

- 0.01 

0.48 

1.06 

50947 

- 1.61 

49 

40 

0.40 

0.86 

- 0.57 

0.66 

- 0.76 

- 0.01 

0.44 

1.19 

50948 

- 1.17 

49 

38 

0.40 

0.90 

- 0.38 

0.76 

- 0.51 

- 0.01 

0.52 

1.14 

50949 

- 1.37 

49 

40 

0.43 

1.22 

0.88 

1.56 

1.20 

- 0.01 

0.30 

0.72 

50950 

- 2.55 

48 

43 

0.55 

0.95 

0.01 

0.63 

- 0.27 

- 0.01 

0.45 

1.07 

50951 

1.75 

49 

12 

0.38 

0.86 

- 0.66 

1.06 

0.27 

- 0.01 

0.47 

1.15 

50952 

0.88 

170 

102 

0.18 

0.92 

- 1.22 

0.81 

- 1.33 

0.00 

0.52 

1.25 

50953 

- 0.18 

49 

31 

0.34 

1.14 

0.92 

1.63 

2.07 

- 0.01 

0.38 

0.62 

50954 

0.07 

49 

30 

0.34 

1.36 

2.58 

1.50 

1.89 

- 0.01 

0.26 

0.01 

50955 

1.42 

47 

14 

0.36 

1.17 

1.00 

1.45 

1.48 

- 0.01 

0.29 

0.62 

50956 

- 0.74 

48 

33 

0.36 

0.97 

- 0.10 

0.90 

- 0.19 

- 0.01 

0.50 

1.06 

50957 

- 0.05 

48 

30 

0.34 

1.03 

0.30 

0.93 

- 0.16 

- 0.01 

0.44 

0.96 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50958 

0.72 

49 

25 

0.32 

0.92 

- 0.68 

0.81 

- 0.92 

- 0.01 

0.52 

1.30 

50959 

- 0.22 

49 

32 

0.34 

1.31 

1.96 

1.24 

0.90 

- 0.01 

0.29 

0.41 

50960 

0.12 

49 

27 

0.32 

1.15 

1.20 

1.16 

0.78 

- 0.01 

0.35 

0.58 

50961 

- 2.26 

48 

42 

0.55 

0.83 

- 0.31 

0.47 

- 0.56 

- 0.01 

0.62 

1.15 

50962 

- 0.68 

277 

230 

0.17 

0.87 

- 1.30 

0.72 

- 1.29 

0.00 

0.44 

1.15 

50963 

- 0.74 

48 

36 

0.38 

0.85 

- 0.71 

0.96 

0.01 

- 0.01 

0.50 

1.14 

50964 

- 1.81 

48 

42 

0.46 

1.11 

0.44 

1.47 

0.88 

- 0.01 

0.14 

0.85 

50965 

- 2.63 

48 

45 

0.61 

0.93 

0.02 

0.89 

0.14 

- 0.01 

0.25 

1.03 

50966 

- 2.34 

49 

42 

0.47 

0.80 

- 0.60 

0.44 

- 0.95 

- 0.01 

0.55 

1.21 

50967 

- 2.12 

49 

43 

0.51 

0.82 

- 0.44 

0.55 

- 0.37 

- 0.01 

0.52 

1.15 

50968 

- 1.51 

49 

39 

0.42 

1.29 

1.19 

2.37 

2.02 

- 0.01 

0.30 

0.49 

50969 

0.00 

49 

27 

0.32 

0.99 

- 0.05 

1.16 

0.82 

- 0.01 

0.38 

0.90 

50970 

- 4.37 

48 

47 

1.05 

0.71 

- 0.07 

0.09 

- 0.69 

- 0.01 

0.36 

1.17 

50971 

- 2.67 

67 

63 

0.55 

0.75 

- 0.53 

0.39 

- 0.61 

- 0.01 

0.38 

1.16 

50972 

- 3.57 

49 

48 

1.02 

0.90 

0.20 

0.25 

- 0.31 

- 0.01 

0.23 

1.09 

50973 

- 1.47 

67 

58 

0.40 

0.70 

- 1.25 

0.40 

- 1.17 

- 0.01 

0.55 

1.29 

50974 

- 1.09 

49 

40 

0.41 

0.93 

- 0.20 

0.88 

- 0.08 

- 0.01 

0.46 

1.06 

50975 

- 0.58 

46 

32 

0.35 

0.95 

- 0.29 

1.07 

0.31 

- 0.01 

0.41 

1.06 

50976 

- 0.04 

49 

27 

0.32 

1.37 

2.90 

1.52 

2.35 

- 0.01 

0.14 

- 0.20 

50977 

0.83 

67 

38 

0.28 

1.17 

1.50 

1.33 

1.62 

- 0.01 

0.36 

0.48 

50978 

- 0.07 

49 

30 

0.32 

0.88 

- 1.05 

0.80 

- 0.80 

- 0.01 

0.49 

1.39 

50979 

- 0.69 

68 

51 

0.31 

1.08 

0.55 

1.46 

1.34 

- 0.01 

0.31 

0.79 

50980 

- 0.93 

48 

35 

0.36 

1.04 

0.27 

1.89 

2.04 

- 0.01 

0.33 

0.81 

50981 

1.64 

49 

15 

0.34 

1.01 

0.10 

1.33 

1.17 

- 0.01 

0.36 

0.89 

50982 

- 1.59 

49 

41 

0.47 

0.82 

- 0.52 

0.68 

- 0.30 

- 0.01 

0.59 

1.15 

50983 

- 1.50 

63 

55 

0.43 

0.97 

- 0.02 

0.64 

- 0.48 

- 0.01 

0.46 

1.07 

50984 

2.32 

49 

11 

0.39 

1.14 

0.71 

1.37 

1.05 

- 0.01 

0.32 

0.79 

50985 

2.24 

49 

11 

0.41 

1.23 

0.97 

2.41 

2.49 

- 0.01 

0.31 

0.58 

50986 

2.15 

47 

8 

0.41 

1.14 

0.64 

1.36 

0.94 

- 0.01 

0.11 

0.81 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50987 

- 1.84 

46 

39 

0.46 

0.86 

- 0.41 

0.57 

- 0.56 

- 0.01 

0.49 

1.16 

50988 

1.37 

57 

23 

0.31 

1.00 

0.02 

1.03 

0.21 

- 0.01 

0.50 

0.99 

50989 

1.61 

49 

16 

0.35 

1.16 

0.98 

1.21 

0.86 

- 0.01 

0.34 

0.71 

50990 

1.08 

48 

17 

0.35 

1.35 

1.98 

1.55 

2.01 

- 0.01 

0.27 

0.34 

50991 

0.76 

64 

32 

0.29 

0.99 

- 0.06 

0.91 

- 0.42 

- 0.01 

0.50 

1.07 

50992 

0.48 

48 

23 

0.32 

0.94 

- 0.46 

0.86 

- 0.46 

- 0.01 

0.49 

1.20 

50993 

0.10 

62 

40 

0.30 

0.92 

- 0.61 

0.95 

- 0.16 

- 0.01 

0.48 

1.16 

50994 

- 0.15 

51 

32 

0.32 

1.10 

0.77 

1.05 

0.30 

- 0.01 

0.37 

0.79 

50995 

- 2.14 

48 

43 

0.49 

1.04 

0.23 

1.18 

0.48 

- 0.01 

0.20 

0.94 

50996 

- 1.40 

53 

44 

0.41 

0.75 

- 1.04 

0.49 

- 0.96 

- 0.01 

0.59 

1.27 

50997 

1.03 

49 

19 

0.33 

1.03 

0.24 

0.98 

- 0.05 

- 0.01 

0.42 

0.96 

50998 

- 0.13 

51 

33 

0.34 

0.93 

- 0.41 

0.82 

- 0.52 

- 0.01 

0.52 

1.17 

50999 

- 1.15 

49 

38 

0.37 

0.87 

- 0.63 

0.84 

- 0.29 

- 0.01 

0.47 

1.16 

51000 

- 0.13 

63 

45 

0.32 

0.94 

- 0.33 

0.80 

- 0.65 

- 0.01 

0.50 

1.14 

51001 

- 2.31 

49 

45 

0.54 

0.96 

0.04 

1.83 

1.06 

- 0.01 

0.20 

0.94 

51002 

- 1.26 

49 

38 

0.38 

1.00 

0.07 

1.27 

0.73 

- 0.01 

0.39 

0.94 

51003 

- 1.20 

52 

42 

0.38 

1.41 

1.77 

2.66 

2.75 

- 0.01 

- 0.07 

0.31 

51004 

0.16 

50 

31 

0.32 

1.13 

1.08 

1.19 

0.93 

- 0.01 

0.27 

0.61 

51005 

0.47 

50 

22 

0.32 

1.27 

2.11 

1.27 

1.35 

- 0.01 

0.23 

0.27 

51006 

0.06 

49 

29 

0.33 

1.00 

0.07 

1.04 

0.25 

- 0.01 

0.45 

0.95 

51007 

- 0.42 

54 

37 

0.33 

1.03 

0.28 

1.44 

1.25 

- 0.01 

0.40 

0.85 

51008 

0.30 

49 

31 

0.33 

1.00 

0.03 

0.90 

- 0.36 

- 0.01 

0.42 

1.05 

51009 

- 0.26 

49 

31 

0.35 

1.14 

0.90 

1.02 

0.18 

- 0.01 

0.45 

0.79 

51010 

0.60 

52 

26 

0.31 

1.15 

1.21 

1.12 

0.52 

- 0.01 

0.36 

0.63 

51011 

- 0.34 

52 

35 

0.34 

1.14 

0.93 

1.08 

0.35 

- 0.01 

0.42 

0.77 

51012 

0.99 

54 

21 

0.33 

1.07 

0.50 

1.04 

0.24 

- 0.01 

0.44 

0.89 

51013 

0.29 

54 

33 

0.31 

0.97 

- 0.21 

0.91 

- 0.40 

- 0.01 

0.45 

1.10 

51014 

- 2.07 

50 

43 

0.49 

1.06 

0.29 

0.77 

- 0.15 

- 0.01 

0.51 

1.00 

51015 

0.00 

54 

54 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

51016 

- 0.57 

55 

39 

0.34 

1.01 

0.09 

0.99 

0.10 

- 0.01 

0.48 

0.99 

51017 

- 0.08 

51 

31 

0.31 

1.01 

0.08 

1.02 

0.19 

- 0.01 

0.40 

0.97 

51018 

- 0.47 

51 

33 

0.35 

1.44 

2.55 

1.29 

0.90 

- 0.01 

0.32 

0.29 

51019 

- 0.08 

55 

36 

0.32 

1.03 

0.25 

0.89 

- 0.35 

- 0.01 

0.43 

1.00 

51020 

- 3.20 

54 

51 

0.74 

1.12 

0.40 

1.87 

1.00 

- 0.01 

0.32 

0.86 

51021 

- 1.01 

53 

41 

0.37 

1.21 

1.07 

1.63 

1.41 

- 0.01 

0.31 

0.69 

51022 

- 1.25 

56 

43 

0.36 

1.25 

1.36 

1.90 

1.71 

- 0.01 

0.29 

0.58 

51023 

- 0.76 

49 

36 

0.36 

1.19 

1.16 

1.16 

0.55 

- 0.01 

0.26 

0.67 

51024 

- 1.20 

55 

46 

0.41 

1.15 

0.67 

1.74 

1.21 

- 0.01 

0.32 

0.79 

51025 

1.09 

66 

33 

0.28 

1.27 

2.62 

1.34 

1.34 

- 0.01 

0.25 

0.08 

51026 

0.21 

57 

33 

0.31 

1.07 

0.60 

0.98 

0.02 

- 0.01 

0.44 

0.87 

51027 

1.06 

58 

23 

0.30 

0.93 

- 0.57 

0.92 

- 0.40 

- 0.01 

0.52 

1.17 

51028 

1.18 

67 

33 

0.28 

0.82 

- 1.79 

0.76 

- 1.61 

- 0.01 

0.59 

1.54 

51029 

0.62 

56 

28 

0.30 

0.96 

- 0.35 

0.90 

- 0.62 

- 0.01 

0.48 

1.16 

51030 

0.34 

52 

24 

0.31 

1.05 

0.44 

0.98 

- 0.03 

- 0.01 

0.42 

0.91 

51031 

0.59 

50 

21 

0.32 

0.97 

- 0.19 

1.01 

0.12 

- 0.01 

0.44 

1.05 

51032 

0.55 

52 

27 

0.31 

0.95 

- 0.41 

0.96 

- 0.13 

- 0.01 

0.47 

1.13 

51033 

0.00 

51 

0 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

51034 

3.22 

55 

7 

0.44 

1.29 

1.04 

2.27 

1.89 

- 0.01 

0.06 

0.64 

51035 

0.89 

53 

22 

0.31 

0.84 

- 1.32 

0.84 

- 0.91 

- 0.01 

0.56 

1.39 

51036 

2.71 

50 

7 

0.44 

0.99 

0.04 

2.58 

2.15 

- 0.01 

0.17 

0.82 

51037 

- 0.63 

53 

37 

0.33 

1.15 

1.02 

1.21 

0.75 

- 0.01 

0.31 

0.70 

51038 

- 1.75 

47 

39 

0.41 

1.14 

0.66 

0.96 

0.10 

- 0.01 

0.20 

0.88 

51039 

2.31 

49 

9 

0.40 

1.01 

0.10 

1.38 

0.92 

- 0.01 

0.33 

0.93 

51040 

2.96 

49 

6 

0.50 

1.24 

0.77 

3.83 

2.68 

- 0.01 

0.16 

0.65 

51041 

1.92 

53 

13 

0.34 

1.21 

1.29 

1.79 

1.56 

- 0.01 

0.13 

0.52 

51042 

2.08 

50 

10 

0.40 

1.25 

1.01 

1.50 

1.32 

- 0.01 

0.23 

0.72 

51043 

2.54 

61 

10 

0.38 

1.42 

1.78 

2.53 

2.60 

0.00 

- 0.06 

0.44 

51044 

2.14 

64 

19 

0.31 

1.06 

0.46 

1.63 

1.77 

- 0.01 

0.39 

0.82 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

51045 

1.63 

52 

11 

0.37 

1.09 

0.49 

1.25 

0.65 

-0.01 

0.27 

0.84 

51046 

1.03 

47 

19 

0.34 

0.89 

-0.69 

0.90 

-0.40 

-0.01 

0.55 

1.21 

51047 

0.35 

52 

29 

0.31 

0.97 

-0.17 

0.89 

-0.47 

-0.01 

0.48 

1.11 

51048 

0.06 

48 

28 

0.32 

0.99 

-0.04 

0.93 

-0.36 

-0.01 

0.40 

1.07 

51049 

1.57 

47 

14 

0.35 

1.23 

1.32 

1.44 

1.46 

-0.01 

0.18 

0.52 

51050 

1.43 

53 

19 

0.32 

0.88 

-0.79 

1.04 

0.28 

-0.01 

0.52 

1.17 

51051 

-1.63 

57 

50 

0.46 

1.11 

0.43 

0.67 

-0.38 

-0.01 

0.44 

1.00 

51052 

-0.43 

47 

33 

0.35 

0.96 

-0.25 

0.82 

-0.60 

-0.01 

0.41 

1.14 

51053 

-1.15 

48 

37 

0.39 

1.00 

0.08 

1.96 

1.95 

-0.01 

0.41 

0.89 

51054 

-1.26 

52 

40 

0.38 

0.99 

0.00 

0.79 

-0.31 

-0.01 

0.48 

1.06 

51055 

-1.89 

53 

45 

0.43 

0.97 

-0.02 

0.75 

-0.22 

-0.01 

0.45 

1.06 

51056 

-0.50 

46 

29 

0.36 

0.97 

-0.14 

1.09 

0.43 

-0.01 

0.51 

0.99 

51057 

-1.05 

53 

42 

0.36 

0.78 

-1.19 

0.54 

-1.26 

-0.01 

0.55 

1.34 

51058 

-0.84 

51 

38 

0.35 

0.75 

-1.56 

0.56 

-1.46 

-0.01 

0.60 

1.44 

51059 

-0.98 

63 

50 

0.36 

0.68 

-1.60 

0.48 

-1.54 

-0.01 

0.66 

1.34 

51060 

-1.27 

47 

40 

0.44 

0.81 

-0.64 

0.54 

-0.84 

-0.01 

0.51 

1.21 

51061 

0.09 

64 

39 

0.29 

1.03 

0.29 

1.15 

0.84 

-0.01 

0.41 

0.88 

51062 

0.17 

52 

31 

0.32 

1.03 

0.23 

0.94 

-0.22 

-0.01 

0.47 

0.99 

51063 

-0.16 

49 

30 

0.34 

0.81 

-1.42 

0.73 

-1.20 

-0.01 

0.57 

1.48 

51064 

-1.30 

50 

42 

0.43 

1.18 

0.75 

1.40 

0.81 

-0.01 

0.26 

0.77 

51065 

-1.20 

50 

42 

0.43 

0.86 

-0.47 

0.54 

-0.86 

-0.01 

0.52 

1.18 

51066 

-0.40 

53 

40 

0.35 

1.09 

0.56 

1.00 

0.13 

-0.01 

0.35 

0.87 

51067 

-2.09 

48 

42 

0.46 

0.83 

-0.49 

0.57 

-0.61 

-0.01 

0.41 

1.17 

51068 

-1.29 

56 

46 

0.38 

0.91 

-0.32 

0.64 

-0.74 

-0.01 

0.47 

1.14 

51069 

-0.85 

52 

38 

0.35 

0.93 

-0.37 

0.87 

-0.24 

-0.01 

0.48 

1.11 

51070 

-0.15 

48 

31 

0.34 

1.05 

0.39 

1.17 

0.71 

-0.01 

0.39 

0.84 

51071 

0.44 

50 

25 

0.33 

0.81 

-1.45 

0.71 

-1.33 

-0.01 

0.62 

1.47 

51072 

0.27 

54 

30 

0.31 

0.97 

-0.25 

0.88 

-0.53 

-0.01 

0.49 

1.13 

51073 

1.11 

42 

19 

0.37 

0.93 

-0.37 

1.05 

0.30 

-0.01 

0.55 

1.08 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

51074 

- 0.25 

50 

33 

0.35 

0.95 

- 0.27 

0.88 

- 0.38 

- 0.01 

0.51 

1.12 

51075 

- 0.29 

49 

30 

0.33 

1.03 

0.31 

1.08 

0.42 

- 0.01 

0.37 

0.89 

51076 

0.74 

53 

29 

0.31 

1.04 

0.42 

1.01 

0.12 

- 0.01 

0.39 

0.88 

51077 

0.01 

53 

33 

0.32 

0.86 

- 1.12 

0.99 

0.05 

- 0.01 

0.53 

1.25 

51078 

1.62 

54 

16 

0.34 

1.26 

1.60 

1.38 

1.17 

- 0.01 

0.28 

0.52 

51079 

0.31 

51 

29 

0.33 

0.99 

- 0.03 

1.11 

0.56 

- 0.01 

0.48 

0.96 

51080 

0.46 

53 

25 

0.32 

0.99 

- 0.05 

0.88 

- 0.40 

- 0.01 

0.49 

1.08 

51081 

0.15 

47 

26 

0.34 

1.09 

0.73 

1.01 

0.13 

- 0.01 

0.42 

0.81 

51082 

0.02 

68 

43 

0.29 

1.04 

0.35 

1.09 

0.52 

- 0.01 

0.43 

0.90 

51083 

- 0.51 

50 

33 

0.33 

0.75 

- 1.89 

0.63 

- 1.68 

- 0.01 

0.64 

1.57 

51084 

0.32 

63 

38 

0.29 

0.94 

- 0.49 

0.87 

- 0.76 

- 0.01 

0.49 

1.18 

51085 

0.23 

58 

35 

0.30 

0.89 

- 0.87 

0.91 

- 0.43 

- 0.01 

0.53 

1.24 

51086 

0.63 

48 

22 

0.33 

0.97 

- 0.20 

0.98 

- 0.06 

- 0.01 

0.49 

1.07 

51087 

- 0.09 

48 

28 

0.32 

0.97 

- 0.23 

0.99 

- 0.03 

- 0.01 

0.39 

1.07 

51088 

0.58 

54 

30 

0.31 

0.95 

- 0.41 

0.85 

- 0.64 

- 0.01 

0.48 

1.20 

51089 

0.06 

60 

37 

0.30 

0.85 

- 1.28 

0.72 

- 1.38 

- 0.01 

0.58 

1.40 

51090 

0.53 

46 

22 

0.33 

0.91 

- 0.69 

0.82 

- 0.87 

- 0.01 

0.52 

1.30 

51091 

- 0.33 

52 

37 

0.35 

0.80 

- 1.32 

0.66 

- 0.90 

- 0.01 

0.56 

1.38 

51092 

0.92 

57 

27 

0.30 

1.07 

0.60 

1.08 

0.45 

- 0.01 

0.40 

0.81 

51093 

- 0.78 

61 

46 

0.33 

0.98 

- 0.10 

0.77 

- 0.61 

- 0.01 

0.43 

1.10 

51094 

- 1.73 

48 

42 

0.47 

0.86 

- 0.36 

0.77 

- 0.23 

- 0.01 

0.41 

1.10 

51095 

- 0.73 

56 

41 

0.35 

1.08 

0.49 

1.17 

0.57 

- 0.01 

0.42 

0.86 

51096 

0.48 

50 

25 

0.33 

1.66 

4.11 

2.36 

4.13 

- 0.01 

0.04 

- 0.76 

51097 

- 1.53 

49 

42 

0.43 

0.94 

- 0.13 

0.74 

- 0.19 

- 0.01 

0.34 

1.08 

51098 

- 1.87 

51 

44 

0.46 

1.12 

0.52 

0.82 

- 0.04 

- 0.01 

0.36 

0.94 

51099 

- 0.97 

49 

38 

0.39 

0.90 

- 0.39 

0.82 

- 0.29 

- 0.01 

0.53 

1.11 

51100 

- 1.55 

47 

39 

0.42 

0.81 

- 0.74 

0.59 

- 0.62 

- 0.01 

0.49 

1.22 

51151 

- 3.26 

48 

46 

0.74 

0.86 

- 0.04 

0.35 

- 0.44 

- 0.01 

0.33 

1.11 

51152 

- 1.37 

64 

54 

0.37 

0.98 

- 0.01 

4.10 

3.61 

- 0.01 

0.26 

0.89 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

51153 

- 3.16 

50 

48 

0.73 

1.02 

0.25 

0.84 

0.16 

- 0.01 

0.12 

0.99 

51154 

- 1.66 

48 

41 

0.44 

1.01 

0.13 

1.04 

0.27 

- 0.01 

0.32 

0.98 

51155 

- 0.79 

51 

37 

0.35 

0.84 

- 0.98 

0.66 

- 0.82 

- 0.01 

0.53 

1.32 

51156 

0.16 

51 

30 

0.32 

1.00 

0.06 

0.98 

- 0.01 

- 0.01 

0.47 

1.00 

51157 

- 0.19 

50 

31 

0.32 

1.29 

2.12 

1.47 

1.95 

- 0.01 

0.17 

0.21 

51158 

1.00 

49 

20 

0.34 

0.90 

- 0.65 

0.88 

- 0.46 

- 0.01 

0.50 

1.21 

51159 

0.40 

255 

176 

0.15 

0.78 

- 3.70 

0.67 

- 3.16 

0.00 

0.58 

1.48 

51160 

- 1.69 

50 

43 

0.44 

1.22 

0.87 

1.60 

1.13 

- 0.01 

0.12 

0.74 

51161 

0.40 

60 

37 

0.31 

1.28 

1.92 

1.50 

1.90 

- 0.01 

0.32 

0.37 

51162 

0.73 

49 

22 

0.34 

1.24 

1.55 

1.25 

1.06 

- 0.01 

0.39 

0.54 

51163 

1.30 

55 

21 

0.33 

1.04 

0.33 

0.95 

0.01 

- 0.01 

0.49 

0.95 

51164 

1.43 

67 

28 

0.28 

0.75 

- 2.31 

0.65 

- 2.15 

0.00 

0.66 

1.60 

51165 

1.10 

48 

20 

0.33 

0.96 

- 0.24 

0.99 

0.01 

- 0.01 

0.48 

1.06 

51166 

1.09 

49 

21 

0.34 

0.77 

- 1.78 

0.69 

- 1.58 

- 0.01 

0.64 

1.55 

51167 

0.74 

48 

24 

0.34 

0.99 

- 0.04 

1.00 

0.06 

- 0.01 

0.49 

1.01 

51168 

- 0.02 

282 

225 

0.16 

0.84 

- 1.90 

0.68 

- 2.28 

0.00 

0.51 

1.22 

51169 

0.03 

280 

218 

0.16 

0.82 

- 2.20 

0.64 

- 2.69 

0.00 

0.56 

1.26 

51170 

- 0.13 

55 

35 

0.33 

0.85 

- 1.01 

0.68 

- 1.16 

- 0.01 

0.60 

1.33 

51171 

- 0.06 

274 

201 

0.15 

1.01 

0.15 

0.91 

- 0.50 

0.00 

0.37 

1.01 

51172 

0.23 

50 

28 

0.32 

0.88 

- 0.94 

0.77 

- 1.09 

- 0.01 

0.57 

1.34 

51173 

- 2.35 

53 

48 

0.51 

0.94 

- 0.08 

1.04 

0.33 

- 0.01 

0.31 

1.00 

51174 

1.40 

56 

21 

0.33 

0.92 

- 0.49 

0.78 

- 0.73 

0.00 

0.60 

1.18 

51175 

- 0.78 

50 

36 

0.34 

0.93 

- 0.41 

0.78 

- 0.68 

- 0.01 

0.44 

1.18 

51176 

2.83 

47 

7 

0.50 

0.92 

- 0.12 

2.27 

1.77 

- 0.01 

0.49 

0.92 

51177 

2.75 

49 

9 

0.41 

1.65 

2.41 

3.31 

3.05 

0.00 

- 0.10 

0.05 

51178 

0.83 

48 

23 

0.33 

0.80 

- 1.56 

0.70 

- 1.47 

- 0.01 

0.61 

1.54 

51179 

0.51 

47 

25 

0.33 

1.07 

0.57 

1.02 

0.17 

- 0.01 

0.38 

0.83 

51180 

0.17 

49 

28 

0.32 

1.14 

1.16 

1.11 

0.70 

- 0.01 

0.32 

0.62 

51181 

0.92 

48 

20 

0.33 

1.32 

2.25 

2.11 

3.62 

- 0.01 

0.16 

- 0.04 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

51182 

0.91 

49 

22 

0.32 

0.83 

- 1.50 

0.82 

- 0.79 

- 0.01 

0.57 

1.46 

51183 

1.35 

48 

18 

0.33 

1.41 

2.81 

1.67 

2.93 

- 0.01 

0.01 

- 0.11 

51184 

1.25 

49 

18 

0.34 

1.12 

0.82 

1.08 

0.42 

- 0.01 

0.39 

0.78 

51185 

1.84 

50 

13 

0.36 

0.95 

- 0.22 

0.75 

- 0.77 

0.00 

0.50 

1.14 

51186 

- 0.80 

57 

43 

0.35 

1.23 

1.29 

1.54 

1.21 

- 0.01 

0.28 

0.58 

51187 

1.88 

60 

20 

0.32 

1.45 

2.62 

1.76 

2.20 

0.00 

0.24 

0.23 

51188 

- 0.69 

48 

35 

0.36 

1.20 

1.13 

1.75 

1.87 

- 0.01 

0.23 

0.55 

51189 

3.17 

49 

4 

0.57 

1.03 

0.22 

1.62 

0.95 

- 0.01 

0.22 

0.91 

51190 

1.62 

48 

14 

0.36 

1.06 

0.40 

0.93 

- 0.05 

- 0.01 

0.43 

0.94 

51191 

2.25 

64 

14 

0.34 

1.36 

1.70 

2.33 

2.62 

- 0.01 

0.15 

0.45 

51192 

3.86 

67 

6 

0.49 

0.71 

- 0.87 

0.89 

0.14 

0.00 

0.51 

1.14 

51193 

1.45 

56 

17 

0.33 

1.10 

0.63 

1.20 

0.85 

- 0.01 

0.37 

0.84 

51194 

2.59 

64 

13 

0.36 

1.31 

1.46 

1.95 

1.90 

0.00 

0.28 

0.60 

51195 

1.39 

48 

15 

0.36 

1.25 

1.30 

1.47 

1.52 

- 0.01 

0.32 

0.60 

51196 

1.29 

55 

17 

0.32 

1.09 

0.66 

1.49 

1.91 

- 0.01 

0.28 

0.72 

51197 

1.92 

52 

11 

0.36 

1.01 

0.09 

1.41 

1.25 

- 0.01 

0.27 

0.92 

51198 

1.09 

48 

18 

0.34 

1.60 

3.75 

1.87 

2.80 

- 0.01 

0.00 

- 0.40 

51199 

0.17 

47 

26 

0.32 

1.12 

1.01 

1.13 

0.68 

- 0.01 

0.32 

0.65 

51200 

- 0.84 

48 

34 

0.34 

1.08 

0.61 

1.01 

0.13 

- 0.01 

0.26 

0.85 

5G11 

1.51 

127 

69 

0.20 

1.18 

2.39 

1.30 

2.07 

0.00 

0.28 

0.40 

5G110 

- 2.12 

118 

115 

0.59 

0.99 

0.17 

0.50 

- 0.55 

0.00 

0.20 

1.03 

5G111 

- 1.55 

112 

106 

0.43 

1.00 

0.13 

0.82 

- 0.14 

0.00 

0.22 

1.01 

5G112 

- 2.12 

339 

326 

0.29 

0.97 

- 0.04 

0.66 

- 0.81 

0.00 

0.21 

1.04 

5G113 

- 0.37 

204 

169 

0.19 

0.96 

- 0.27 

0.95 

- 0.21 

0.00 

0.29 

1.04 

5G114 

- 0.24 

98 

83 

0.29 

1.05 

0.33 

1.38 

1.22 

0.00 

0.15 

0.89 

5G115 

- 0.04 

108 

82 

0.24 

0.95 

- 0.43 

0.92 

- 0.24 

0.00 

0.37 

1.08 

5G116 

0.00 

102 

102 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

5G117 

- 0.47 

128 

109 

0.26 

1.01 

0.11 

0.92 

- 0.18 

0.00 

0.25 

1.01 

5G118 

- 2.28 

127 

122 

0.47 

1.04 

0.23 

0.70 

- 0.27 

0.00 

0.18 

1.01 



easyCBM CCSS Fifth Grade Math Measure Development 


204 

Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5G119 

-0.05 

213 

151 

0.16 

0.97 

-0.35 

0.88 

-1.04 

0.00 

0.37 

1.09 

5G120 

0.90 

115 

80 

0.22 

1.02 

0.21 

0.91 

-0.49 

0.00 

0.41 

1.01 

5G121 

0.54 

104 

69 

0.23 

1.05 

0.56 

1.07 

0.49 

0.00 

0.34 

0.87 

5G122 

-0.33 

111 

91 

0.26 

0.92 

-0.49 

0.81 

-0.70 

0.00 

0.36 

1.10 

5G123 

1.63 

113 

58 

0.22 

1.19 

2.19 

1.26 

1.74 

0.00 

0.32 

0.45 

5G124 

1.18 

128 

64 

0.20 

1.02 

0.38 

1.06 

0.64 

0.00 

0.39 

0.89 

5G125 

1.36 

97 

35 

0.23 

0.93 

-0.78 

0.94 

-0.55 

0.00 

0.41 

1.19 

5G13 

0.27 

208 

162 

0.18 

0.90 

-1.11 

0.72 

-1.34 

0.00 

0.46 

1.17 

5G14 

1.31 

127 

74 

0.20 

0.87 

-1.79 

0.82 

-1.28 

0.00 

0.53 

1.39 

5G15 

1.17 

118 

76 

0.21 

1.03 

0.44 

0.99 

-0.07 

0.00 

0.33 

0.94 

5G16 

3.01 

112 

28 

0.23 

1.13 

1.13 

1.16 

0.86 

0.00 

0.21 

0.78 

5G17 

1.02 

123 

83 

0.21 

1.13 

1.51 

1.06 

0.51 

0.00 

0.24 

0.74 

5G18 

-3.20 

98 

97 

1.01 

1.00 

0.32 

0.51 

-0.12 

0.00 

0.12 

1.02 

5G19 

-3.02 

108 

106 

0.72 

1.02 

0.26 

8.05 

3.56 

0.00 

-0.07 

0.90 

5G21 

2.27 

101 

53 

0.22 

0.98 

-0.19 

0.96 

-0.26 

0.00 

0.47 

1.06 

5G210 

0.05 

128 

100 

0.23 

0.88 

-0.99 

0.79 

-0.92 

0.00 

0.39 

1.18 

5G211 

-0.19 

126 

99 

0.23 

0.95 

-0.39 

0.82 

-0.72 

0.00 

0.38 

1.09 

5G212 

-0.85 

115 

105 

0.35 

1.13 

0.57 

1.77 

1.46 

0.00 

0.05 

0.82 

5G213 

-1.95 

204 

195 

0.35 

1.04 

0.23 

1.25 

0.66 

0.00 

0.08 

0.96 

5G214 

-2.14 

103 

98 

0.52 

0.91 

-0.05 

0.46 

-0.74 

0.00 

0.39 

1.08 

5G215 

-3.63 

111 

110 

1.01 

1.00 

0.33 

0.59 

-0.05 

0.00 

0.09 

1.01 

5G216 

-1.91 

112 

107 

0.47 

0.95 

0.01 

0.52 

-0.62 

0.00 

0.26 

1.05 

5G217 

0.71 

126 

75 

0.20 

1.11 

1.43 

1.26 

2.33 

0.00 

0.28 

0.61 

5G218 

0.26 

96 

58 

0.22 

0.84 

-2.38 

0.79 

-2.01 

0.00 

0.52 

1.68 

5G219 

1.91 

125 

58 

0.20 

1.20 

2.41 

1.19 

1.51 

0.00 

0.29 

0.48 

5G22 

1.65 

117 

64 

0.20 

0.98 

-0.25 

1.16 

1.73 

0.00 

0.35 

0.97 

5G220 

0.14 

111 

88 

0.25 

0.88 

-0.83 

0.86 

-0.58 

0.00 

0.45 

1.13 

5G221 

0.98 

122 

83 

0.21 

0.98 

-0.19 

0.98 

-0.10 

0.00 

0.37 

1.04 

5G222 

-0.16 

98 

82 

0.29 

1.04 

0.26 

1.10 

0.44 

0.00 

0.22 

0.95 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5G223 

0.39 

108 

74 

0.22 

0.96 

- 0.43 

0.83 

- 0.89 

0.00 

0.42 

1.15 

5G224 

- 1.03 

101 

96 

0.47 

1.07 

0.32 

1.93 

1.26 

0.00 

0.08 

0.91 

5G225 

0.43 

126 

91 

0.21 

0.97 

- 0.31 

1.23 

1.22 

0.00 

0.29 

0.97 

5G23 

0.48 

125 

85 

0.21 

0.95 

- 0.53 

0.84 

- 1.03 

0.00 

0.42 

1.16 

5G24 

2.21 

247 

87 

0.15 

1.18 

2.64 

1.21 

2.26 

0.00 

0.27 

0.61 

5G25 

- 0.18 

115 

98 

0.28 

1.04 

0.26 

1.06 

0.28 

0.00 

0.28 

0.95 

5G26 

0.01 

100 

77 

0.25 

0.96 

- 0.28 

0.81 

- 0.85 

0.00 

0.36 

1.10 

5G27 

0.10 

224 

182 

0.18 

0.98 

- 0.11 

1.05 

0.34 

0.00 

0.31 

1.00 

5G28 

- 1.59 

111 

104 

0.40 

1.05 

0.25 

0.99 

0.16 

0.00 

0.13 

0.97 

5G29 

0.97 

112 

71 

0.22 

1.00 

0.02 

0.90 

- 0.48 

0.00 

0.45 

1.04 

5G31 

- 0.46 

214 

188 

0.22 

0.94 

- 0.34 

0.83 

- 0.65 

0.00 

0.33 

1.06 

5G310 

0.39 

125 

83 

0.20 

0.94 

- 0.74 

0.87 

- 1.00 

0.00 

0.43 

1.18 

5G311 

- 0.96 

96 

79 

0.28 

0.95 

- 0.24 

0.82 

- 0.67 

0.00 

0.32 

1.08 

5G312 

0.99 

125 

81 

0.20 

1.10 

1.23 

1.17 

0.96 

0.00 

0.30 

0.71 

5G313 

1.20 

117 

75 

0.21 

0.85 

- 2.08 

0.79 

- 1.90 

0.00 

0.52 

1.48 

5G314 

0.94 

215 

134 

0.15 

0.98 

- 0.39 

0.98 

- 0.16 

0.00 

0.40 

1.05 

5G315 

0.51 

225 

171 

0.17 

0.91 

- 1.07 

0.81 

- 1.06 

0.00 

0.42 

1.16 

5G316 

0.51 

110 

81 

0.23 

0.86 

- 1.23 

0.81 

- 1.07 

0.00 

0.51 

1.23 

5G317 

2.87 

122 

36 

0.21 

1.29 

2.77 

1.60 

3.60 

0.00 

0.01 

0.35 

5G318 

1.60 

98 

51 

0.22 

1.29 

3.53 

1.32 

3.01 

0.00 

0.08 

- 0.06 

5G319 

1.19 

108 

57 

0.21 

1.25 

3.00 

1.30 

2.22 

0.00 

0.20 

0.22 

5G32 

1.66 

210 

106 

0.15 

1.07 

1.15 

1.05 

0.61 

0.00 

0.37 

0.82 

5G320 

0.46 

101 

84 

0.29 

1.16 

0.97 

1.10 

0.40 

0.00 

0.21 

0.83 

5G321 

0.54 

125 

88 

0.21 

1.05 

0.58 

1.08 

0.53 

0.00 

0.26 

0.87 

5G322 

0.52 

125 

84 

0.21 

0.91 

- 1.11 

0.87 

- 0.82 

0.00 

0.44 

1.22 

5G323 

0.75 

115 

83 

0.23 

0.98 

- 0.14 

0.91 

- 0.43 

0.00 

0.42 

1.05 

5G324 

1.59 

99 

46 

0.22 

0.94 

- 0.77 

0.97 

- 0.27 

0.00 

0.44 

1.18 

5G325 

1.85 

110 

45 

0.21 

0.93 

- 0.86 

0.90 

- 1.00 

0.00 

0.46 

1.23 

5G33 

1.02 

110 

69 

0.22 

0.87 

- 1.47 

0.82 

- 1.02 

0.00 

0.52 

1.32 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5G34 

-0.15 

125 

95 

0.22 

1.03 

0.33 

1.11 

0.63 

0.00 

0.28 

0.92 

5G35 

1.21 

96 

38 

0.22 

1.09 

1.16 

1.14 

1.37 

0.00 

0.21 

0.65 

5G36 

1.21 

112 

69 

0.21 

1.27 

3.23 

1.52 

2.71 

0.00 

0.15 

0.13 

5G37 

1.47 

115 

67 

0.20 

0.93 

-1.09 

0.89 

-1.07 

0.00 

0.44 

1.29 

5G38 

1.50 

104 

57 

0.22 

1.02 

0.21 

0.99 

-0.03 

0.00 

0.40 

0.97 

5G39 

-0.78 

114 

104 

0.34 

1.00 

0.07 

0.93 

-0.03 

0.00 

0.24 

1.01 

5G41 

0.34 

98 

75 

0.25 

1.03 

0.25 

1.05 

0.32 

0.00 

0.27 

0.94 

5G410 

-0.01 

107 

81 

0.24 

0.85 

-1.36 

0.68 

-1.39 

0.00 

0.48 

1.29 

5G411 

1.24 

100 

72 

0.25 

1.11 

0.96 

1.16 

0.72 

0.00 

0.30 

0.79 

5G412 

0.63 

124 

85 

0.21 

0.98 

-0.20 

0.89 

-0.64 

0.00 

0.34 

1.09 

5G413 

0.32 

122 

87 

0.22 

0.94 

-0.62 

0.99 

-0.01 

0.00 

0.38 

1.12 

5G414 

4.47 

113 

12 

0.32 

1.23 

1.03 

2.51 

2.70 

0.00 

0.00 

0.72 

5G415 

0.71 

96 

62 

0.23 

1.04 

0.45 

1.25 

1.66 

0.00 

0.29 

0.82 

5G416 

0.95 

106 

64 

0.21 

0.94 

-0.80 

1.18 

1.47 

0.00 

0.39 

1.12 

5G417 

-0.10 

248 

197 

0.17 

0.95 

-0.57 

1.11 

0.68 

0.00 

0.32 

1.06 

5G418 

0.86 

105 

70 

0.23 

0.98 

-0.13 

0.95 

-0.20 

0.00 

0.40 

1.04 

5G419 

0.15 

213 

143 

0.16 

1.01 

0.16 

1.01 

0.11 

0.00 

0.33 

0.97 

5G42 

0.68 

117 

71 

0.21 

0.98 

-0.21 

0.96 

-0.32 

0.00 

0.40 

1.07 

5G420 

0.45 

96 

54 

0.22 

1.06 

0.90 

1.24 

2.25 

0.00 

0.21 

0.60 

5G421 

1.34 

112 

66 

0.21 

0.89 

-1.41 

0.89 

-0.69 

0.00 

0.49 

1.31 

5G422 

-2.05 

115 

112 

0.59 

1.00 

0.19 

0.63 

-0.31 

0.00 

0.15 

1.02 

5G423 

0.21 

103 

81 

0.26 

0.94 

-0.37 

0.99 

0.03 

0.00 

0.39 

1.05 

5G424 

0.88 

113 

79 

0.22 

0.92 

-0.79 

0.83 

-1.13 

0.00 

0.45 

1.19 

5G425 

1.78 

97 

47 

0.22 

0.90 

-1.35 

0.88 

-1.21 

0.00 

0.49 

1.37 

5G43 

1.43 

106 

51 

0.22 

1.13 

1.58 

1.14 

1.14 

0.00 

0.32 

0.62 

5G44 

-0.64 

100 

93 

0.41 

0.90 

-0.23 

0.52 

-0.76 

0.00 

0.34 

1.09 

5G45 

0.83 

124 

80 

0.20 

1.08 

1.09 

1.07 

0.52 

0.00 

0.26 

0.76 

5G46 

0.96 

122 

72 

0.20 

1.02 

0.28 

1.00 

0.00 

0.00 

0.37 

0.95 

5G47 

0.39 

113 

88 

0.25 

0.75 

-2.05 

0.57 

-2.03 

0.00 

0.59 

1.36 



easyCBM CCSS Fifth Grade Math Measure Development 


207 

Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5G48 

0.60 

96 

64 

0.23 

0.87 

-1.51 

0.77 

-1.58 

0.00 

0.47 

1.39 

5G49 

0.33 

205 

150 

0.17 

0.99 

-0.10 

0.99 

-0.01 

0.00 

0.36 

1.02 

5MD11 

2.49 

105 

30 

0.23 

1.08 

0.69 

1.05 

0.39 

0.00 

0.30 

0.88 

5MD110 

1.98 

105 

47 

0.22 

1.16 

1.80 

1.27 

1.90 

0.00 

0.31 

0.52 

5MD111 

0.73 

116 

69 

0.21 

0.92 

-1.03 

0.85 

-1.42 

0.00 

0.46 

1.29 

5MD112 

2.09 

96 

22 

0.26 

1.32 

2.14 

1.53 

2.53 

0.00 

-0.10 

0.52 

5MD113 

1.45 

111 

63 

0.21 

1.13 

1.70 

1.13 

0.90 

0.00 

0.31 

0.60 

5MD114 

2.49 

115 

42 

0.21 

1.14 

1.72 

1.19 

1.71 

0.00 

0.19 

0.58 

5MD115 

1.20 

103 

63 

0.22 

0.91 

-1.06 

0.89 

-0.94 

0.00 

0.49 

1.25 

5MD116 

0.93 

112 

77 

0.22 

1.05 

0.55 

1.06 

0.43 

0.00 

0.30 

0.89 

5MD117 

0.78 

97 

67 

0.23 

1.02 

0.28 

0.99 

-0.03 

0.00 

0.33 

0.96 

5MD118 

1.94 

212 

90 

0.15 

0.97 

-0.41 

0.93 

-0.75 

0.00 

0.45 

1.09 

5MD119 

1.36 

105 

52 

0.22 

0.99 

-0.06 

0.94 

-0.45 

0.00 

0.45 

1.05 

5MD12 

3.08 

100 

37 

0.23 

0.81 

-1.93 

0.88 

-0.78 

0.00 

0.58 

1.34 

5MD120 

1.79 

124 

55 

0.20 

1.27 

3.59 

1.60 

4.98 

0.00 

0.11 

-0.05 

5MD121 

1.52 

122 

58 

0.20 

1.07 

0.92 

1.06 

0.62 

0.00 

0.36 

0.80 

5MD122 

1.49 

112 

66 

0.21 

1.16 

1.78 

1.13 

1.03 

0.00 

0.30 

0.62 

5MD123 

1.83 

95 

39 

0.23 

0.99 

-0.08 

1.02 

0.19 

0.00 

0.40 

1.01 

5MD124 

2.77 

105 

25 

0.25 

0.82 

-1.42 

0.71 

-1.68 

0.00 

0.56 

1.27 

5MD125 

2.15 

104 

43 

0.22 

1.04 

0.41 

1.08 

0.63 

0.00 

0.42 

0.89 

5MD126 

2.44 

116 

30 

0.23 

0.92 

-0.71 

1.05 

0.36 

0.00 

0.45 

1.10 

5MD127 

2.23 

96 

20 

0.27 

1.16 

1.03 

1.48 

2.11 

0.00 

0.06 

0.74 

5MD128 

2.29 

109 

44 

0.22 

1.31 

3.01 

1.52 

3.38 

0.00 

0.19 

0.26 

5MD129 

2.57 

114 

40 

0.21 

1.17 

1.99 

1.23 

1.88 

0.00 

0.15 

0.52 

5MD13 

1.58 

103 

55 

0.22 

1.10 

1.24 

1.10 

0.99 

0.00 

0.31 

0.69 

5MD130 

3.15 

110 

27 

0.24 

1.02 

0.17 

1.18 

0.96 

0.00 

0.30 

0.94 

5MD14 

2.65 

97 

30 

0.24 

1.19 

1.69 

1.29 

1.81 

0.00 

0.16 

0.59 

5MD15 

1.79 

105 

43 

0.22 

1.20 

2.04 

1.24 

1.83 

0.00 

0.27 

0.52 

5MD16 

3.18 

213 

38 

0.20 

0.97 

-0.24 

1.41 

1.88 

0.00 

0.43 

0.99 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5MD17 

3.86 

100 

24 

0.26 

1.21 

1.47 

1.64 

2.32 

0.00 

0.24 

0.67 

5MD18 

2.69 

124 

34 

0.22 

1.14 

1.25 

1.24 

1.49 

0.00 

0.27 

0.76 

5MD19 

1.85 

122 

50 

0.20 

1.11 

1.33 

1.16 

1.41 

0.00 

0.33 

0.69 

5MD21 

0.78 

110 

79 

0.23 

0.94 

-0.57 

0.80 

-1.05 

0.00 

0.47 

1.15 

5MD210 

-0.42 

95 

79 

0.29 

0.92 

-0.44 

0.68 

-1.13 

0.00 

0.37 

1.14 

5MD211 

0.67 

105 

69 

0.22 

1.03 

0.38 

0.99 

-0.05 

0.00 

0.31 

0.94 

5MD212 

1.33 

104 

60 

0.22 

1.09 

1.08 

1.42 

2.41 

0.00 

0.32 

0.64 

5MD213 

0.29 

116 

79 

0.22 

1.04 

0.50 

1.04 

0.31 

0.00 

0.32 

0.90 

5MD214 

1.44 

95 

33 

0.23 

1.03 

0.36 

1.11 

0.93 

0.00 

0.27 

0.87 

5MD215 

1.84 

107 

53 

0.22 

1.07 

0.84 

1.10 

0.76 

0.00 

0.38 

0.79 

5MD216 

1.78 

114 

59 

0.20 

0.87 

-2.10 

0.83 

-2.04 

0.00 

0.51 

1.57 

5MD217 

1.17 

102 

63 

0.22 

1.04 

0.50 

1.05 

0.42 

0.00 

0.36 

0.89 

5MD218 

1.43 

109 

64 

0.21 

0.90 

-1.28 

0.85 

-1.46 

0.00 

0.49 

1.34 

5MD219 

1.70 

96 

48 

0.22 

0.97 

-0.43 

0.97 

-0.31 

0.00 

0.42 

1.12 

5MD22 

1.68 

104 

45 

0.22 

1.06 

0.68 

1.02 

0.18 

0.00 

0.40 

0.88 

5MD220 

2.00 

100 

58 

0.23 

1.06 

0.64 

0.97 

-0.13 

0.00 

0.41 

0.91 

5MD221 

1.37 

124 

66 

0.19 

0.90 

-1.58 

0.87 

-1.20 

0.00 

0.45 

1.40 

5MD222 

1.25 

121 

64 

0.20 

0.90 

-1.47 

0.87 

-1.31 

0.00 

0.48 

1.35 

5MD223 

2.42 

110 

44 

0.22 

1.46 

4.72 

1.63 

4.11 

0.00 

0.02 

-0.22 

5MD224 

2.39 

95 

29 

0.24 

1.11 

0.93 

1.18 

1.14 

0.00 

0.30 

0.78 

5MD225 

2.08 

105 

38 

0.22 

1.22 

2.33 

1.30 

2.36 

0.00 

0.14 

0.42 

5MD226 

2.58 

214 

72 

0.16 

1.02 

0.38 

1.04 

0.40 

0.00 

0.35 

0.94 

5MD227 

1.57 

104 

55 

0.22 

0.97 

-0.36 

0.95 

-0.28 

0.00 

0.46 

1.09 

5MD228 

1.27 

116 

56 

0.20 

1.01 

0.18 

1.08 

0.86 

0.00 

0.37 

0.91 

5MD229 

1.60 

95 

30 

0.23 

1.17 

1.60 

1.19 

1.37 

0.00 

0.13 

0.63 

5MD23 

1.26 

106 

65 

0.22 

1.05 

0.59 

1.05 

0.34 

0.00 

0.37 

0.86 

5MD230 

1.65 

113 

62 

0.20 

1.17 

2.48 

1.19 

1.97 

0.00 

0.16 

0.31 

5MD24 

1.65 

102 

53 

0.22 

1.04 

0.56 

1.05 

0.54 

0.00 

0.36 

0.86 

5MD25 

2.13 

109 

48 

0.21 

0.99 

-0.04 

1.00 

0.03 

0.00 

0.39 

1.01 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5MD26 

1.07 

95 

60 

0.23 

1.15 

1.70 

1.28 

2.01 

0.00 

0.19 

0.52 

5MD27 

1.29 

104 

53 

0.22 

1.08 

0.98 

1.14 

1.09 

0.00 

0.35 

0.73 

5MD28 

1.95 

100 

59 

0.23 

1.11 

1.22 

1.13 

0.84 

0.00 

0.35 

0.71 

5MD29 

1.03 

124 

75 

0.20 

0.90 

-1.62 

0.84 

-1.24 

0.00 

0.44 

1.40 

5MD41 

0.88 

121 

73 

0.20 

0.91 

-1.27 

0.85 

-1.24 

0.00 

0.46 

1.31 

5MD410 

-0.28 

109 

94 

0.30 

0.81 

-1.01 

0.54 

-1.42 

0.00 

0.49 

1.20 

5MD411 

0.77 

95 

60 

0.23 

0.90 

-1.22 

0.82 

-1.33 

0.00 

0.45 

1.34 

5MD412 

0.91 

105 

64 

0.21 

0.80 

-2.93 

0.74 

-2.28 

0.00 

0.57 

1.71 

5MD413 

0.06 

104 

83 

0.26 

0.96 

-0.22 

0.76 

-0.70 

0.00 

0.37 

1.09 

5MD414 

0.79 

115 

67 

0.21 

0.99 

-0.16 

0.97 

-0.20 

0.00 

0.40 

1.05 

5MD415 

1.00 

95 

42 

0.22 

0.91 

-1.28 

0.88 

-1.31 

0.00 

0.44 

1.40 

5MD416 

0.70 

106 

76 

0.23 

0.87 

-1.30 

0.70 

-1.31 

0.00 

0.48 

1.31 

5MD417 

0.56 

113 

86 

0.23 

0.98 

-0.11 

0.91 

-0.44 

0.00 

0.33 

1.05 

5MD418 

0.47 

101 

75 

0.25 

0.82 

-1.53 

0.69 

-1.72 

0.00 

0.56 

1.31 

5MD419 

1.27 

208 

127 

0.16 

1.08 

1.17 

1.04 

0.32 

0.00 

0.40 

0.84 

5MD42 

1.39 

109 

65 

0.21 

0.86 

-1.91 

0.80 

-1.84 

0.00 

0.53 

1.46 

5MD420 

0.57 

95 

69 

0.24 

0.87 

-1.23 

0.75 

-1.42 

0.00 

0.49 

1.28 

5MD43 

0.42 

104 

71 

0.23 

0.82 

-2.07 

0.68 

-1.84 

0.00 

0.54 

1.47 

5MD44 

0.13 

99 

86 

0.32 

0.86 

-0.66 

0.65 

-0.77 

0.00 

0.42 

1.14 

5MD45 

0.67 

124 

84 

0.20 

0.99 

-0.04 

0.93 

-0.39 

0.00 

0.33 

1.04 

5MD46 

0.22 

121 

88 

0.22 

0.89 

-1.12 

0.79 

-1.19 

0.00 

0.43 

1.24 

5MD47 

0.18 

109 

88 

0.26 

0.85 

-1.04 

0.61 

-1.51 

0.00 

0.51 

1.22 

5MD48 

0.73 

94 

60 

0.23 

0.95 

-0.59 

0.92 

-0.54 

0.00 

0.40 

1.16 

5MD49 

1.09 

105 

60 

0.21 

0.83 

-2.63 

0.77 

-2.26 

0.00 

0.55 

1.69 

5MD51 

-0.23 

104 

87 

0.28 

0.83 

-1.07 

0.71 

-0.73 

0.00 

0.44 

1.20 

5MD510 

0.35 

115 

77 

0.21 

0.95 

-0.59 

0.86 

-0.98 

0.00 

0.42 

1.16 

5MD511 

0.71 

95 

48 

0.22 

0.90 

-1.65 

0.86 

-1.58 

0.00 

0.46 

1.55 

5MD512 

2.09 

105 

47 

0.22 

1.22 

2.31 

1.31 

2.16 

0.00 

0.27 

0.41 

5MD513 

0.56 

113 

86 

0.23 

0.87 

-1.11 

0.75 

-1.38 

0.00 

0.46 

1.23 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5MD514 

2.09 

101 

43 

0.22 

1.12 

1.49 

1.17 

1.42 

0.00 

0.27 

0.60 

5MD515 

2.61 

106 

36 

0.22 

0.93 

-0.79 

0.87 

-0.95 

0.00 

0.46 

1.19 

5MD516 

2.13 

95 

39 

0.23 

0.98 

-0.25 

0.95 

-0.38 

0.00 

0.41 

1.08 

5MD517 

2.30 

104 

33 

0.24 

0.95 

-0.42 

1.09 

0.59 

0.00 

0.46 

1.03 

5MD518 

1.08 

98 

73 

0.25 

0.88 

-0.96 

0.68 

-1.33 

0.00 

0.51 

1.24 

5MD519 

1.60 

124 

60 

0.20 

0.90 

-1.61 

0.90 

-1.01 

0.00 

0.46 

1.38 

5MD52 

1.05 

121 

69 

0.20 

0.72 

-4.23 

0.67 

-3.27 

0.00 

0.61 

1.90 

5MD520 

3.05 

109 

31 

0.23 

1.17 

1.50 

1.57 

2.64 

0.00 

0.21 

0.59 

5MD53 

1.86 

94 

38 

0.23 

1.46 

4.48 

1.57 

4.20 

0.00 

-0.01 

-0.31 

5MD54 

1.94 

105 

41 

0.22 

0.88 

-1.45 

0.91 

-0.83 

0.00 

0.49 

1.31 

5MD55 

2.52 

104 

36 

0.23 

1.09 

0.85 

1.14 

0.93 

0.00 

0.39 

0.82 

5MD56 

0.92 

210 

137 

0.16 

0.79 

-3.48 

0.68 

-3.18 

0.00 

0.58 

1.53 

5MD57 

0.85 

114 

65 

0.21 

0.98 

-0.18 

0.97 

-0.26 

0.00 

0.40 

1.06 

5MD58 

0.80 

95 

46 

0.22 

0.89 

-1.70 

0.86 

-1.61 

0.00 

0.47 

1.55 

5MD59 

2.02 

103 

48 

0.22 

0.94 

-0.70 

0.87 

-0.95 

0.00 

0.51 

1.19 

5NBT11 

2.94 

113 

32 

0.22 

1.15 

1.42 

1.41 

2.53 

0.00 

0.13 

0.65 

5NBT110 

0.59 

101 

73 

0.24 

0.97 

-0.27 

0.98 

-0.07 

0.00 

0.40 

1.05 

5NBT111 

0.90 

103 

71 

0.23 

0.80 

-2.16 

0.68 

-2.26 

0.00 

0.58 

1.47 

5NBT112 

0.81 

94 

64 

0.24 

0.94 

-0.59 

1.07 

0.47 

0.00 

0.38 

1.08 

5NBT113 

2.34 

103 

32 

0.24 

1.11 

0.98 

1.16 

0.98 

0.00 

0.34 

0.80 

5NBT114 

0.50 

98 

81 

0.29 

0.99 

0.01 

1.02 

0.18 

0.00 

0.34 

1.00 

5NBT115 

3.66 

124 

18 

0.28 

1.07 

0.41 

1.34 

1.17 

0.00 

0.32 

0.91 

5NBT12 

1.81 

120 

50 

0.20 

1.31 

3.58 

1.39 

3.23 

0.00 

0.16 

0.12 

5NBT13 

1.80 

109 

57 

0.21 

1.07 

0.82 

1.08 

0.70 

0.00 

0.38 

0.80 

5NBT14 

0.94 

94 

56 

0.23 

1.11 

1.33 

1.13 

1.05 

0.00 

0.27 

0.63 

5NBT15 

2.77 

104 

25 

0.25 

1.28 

2.00 

1.42 

2.09 

0.00 

0.06 

0.58 

5NBT16 

2.20 

104 

42 

0.22 

1.05 

0.53 

1.16 

1.14 

0.00 

0.40 

0.85 

5NBT17 

1.09 

226 

146 

0.15 

1.07 

1.16 

1.16 

1.66 

0.00 

0.29 

0.78 

5NBT18 

-0.46 

113 

91 

0.25 

0.90 

-0.72 

0.79 

-0.85 

0.00 

0.41 

1.14 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5NBT19 

-0.53 

95 

72 

0.25 

0.90 

-0.80 

0.81 

-0.98 

0.00 

0.41 

1.19 

5NBT21 

0.01 

103 

85 

0.27 

0.91 

-0.52 

0.90 

-0.17 

0.00 

0.36 

1.10 

5NBT210 

-0.07 

113 

96 

0.27 

0.94 

-0.31 

0.74 

-0.92 

0.00 

0.36 

1.09 

5NBT211 

2.92 

101 

27 

0.24 

1.02 

0.19 

1.38 

1.84 

0.00 

0.29 

0.89 

5NBT212 

0.45 

103 

79 

0.25 

0.99 

-0.03 

0.99 

0.04 

0.00 

0.34 

1.01 

5NBT213 

-0.59 

94 

83 

0.33 

0.94 

-0.21 

0.77 

-0.54 

0.00 

0.32 

1.07 

5NBT214 

-1.21 

103 

93 

0.34 

0.90 

-0.35 

0.60 

-0.84 

0.00 

0.34 

1.11 

5NBT215 

-1.00 

98 

93 

0.47 

0.94 

-0.04 

0.49 

-0.64 

0.00 

0.29 

1.07 

5NBT22 

0.41 

124 

90 

0.21 

0.95 

-0.51 

0.80 

-1.06 

0.00 

0.37 

1.16 

5NBT23 

0.99 

120 

70 

0.20 

0.98 

-0.28 

0.93 

-0.61 

0.00 

0.41 

1.10 

5NBT24 

0.25 

109 

87 

0.26 

0.89 

-0.79 

0.80 

-0.72 

0.00 

0.46 

1.15 

5NBT25 

-0.33 

94 

77 

0.28 

0.85 

-0.94 

0.62 

-1.49 

0.00 

0.44 

1.22 

5NBT26 

-0.95 

104 

93 

0.33 

1.01 

0.11 

0.87 

-0.20 

0.00 

0.21 

1.00 

5NBT27 

-0.67 

104 

92 

0.32 

0.84 

-0.69 

0.53 

-1.01 

0.00 

0.40 

1.16 

5NBT28 

-1.14 

113 

100 

0.31 

0.92 

-0.33 

0.66 

-0.99 

0.00 

0.35 

1.10 

5NBT29 

-0.53 

95 

72 

0.25 

0.85 

-1.25 

0.74 

-1.40 

0.00 

0.47 

1.28 

5NBT31 

1.78 

103 

53 

0.22 

0.92 

-0.92 

0.88 

-0.83 

0.00 

0.50 

1.23 

5NBT310 

1.44 

113 

67 

0.20 

0.90 

-1.47 

0.83 

-1.67 

0.00 

0.48 

1.41 

5NBT311 

1.85 

101 

48 

0.22 

0.85 

-1.97 

0.84 

-1.58 

0.00 

0.54 

1.48 

5NBT312 

0.86 

102 

71 

0.23 

0.82 

-1.84 

0.71 

-1.91 

0.00 

0.55 

1.40 

5NBT313 

1.99 

94 

41 

0.23 

1.03 

0.43 

1.06 

0.56 

0.00 

0.34 

0.87 

5NBT314 

-0.48 

103 

85 

0.27 

0.96 

-0.22 

0.83 

-0.45 

0.00 

0.34 

1.06 

5NBT315 

-1.00 

98 

93 

0.47 

0.97 

0.06 

0.52 

-0.57 

0.00 

0.27 

1.05 

5NBT316 

2.03 

124 

49 

0.20 

0.97 

-0.34 

0.93 

-0.67 

0.00 

0.43 

1.11 

5NBT317 

1.77 

120 

51 

0.20 

0.97 

-0.32 

0.97 

-0.23 

0.00 

0.43 

1.07 

5NBT318 

0.79 

109 

78 

0.23 

0.87 

-1.19 

0.76 

-1.29 

0.00 

0.52 

1.25 

5NBT319 

0.51 

94 

64 

0.24 

0.96 

-0.40 

0.97 

-0.14 

0.00 

0.36 

1.08 

5NBT32 

0.83 

104 

65 

0.22 

1.12 

1.48 

1.31 

2.22 

0.00 

0.19 

0.55 

5NBT320 

0.19 

104 

81 

0.25 

0.88 

-0.92 

0.77 

-0.72 

0.00 

0.43 

1.18 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5NBT33 

1.18 

113 

57 

0.21 

0.95 

-0.62 

0.99 

-0.11 

0.00 

0.43 

1.13 

5NBT34 

1.14 

95 

39 

0.22 

1.01 

0.11 

1.00 

0.03 

0.00 

0.33 

0.98 

5NBT35 

2.37 

103 

41 

0.23 

1.17 

1.62 

1.37 

2.45 

0.00 

0.30 

0.58 

5NBT36 

2.01 

113 

53 

0.20 

0.91 

-1.38 

0.88 

-1.42 

0.00 

0.47 

1.38 

5NBT37 

-0.60 

101 

89 

0.32 

0.94 

-0.22 

0.96 

0.01 

0.00 

0.32 

1.03 

5NBT38 

2.55 

102 

36 

0.22 

1.06 

0.66 

1.11 

0.89 

0.00 

0.31 

0.84 

5NBT39 

1.57 

328 

158 

0.12 

0.88 

-2.76 

0.86 

-2.07 

0.00 

0.52 

1.36 

5NBT41 

1.59 

94 

49 

0.22 

0.83 

-2.27 

0.80 

-2.04 

0.00 

0.56 

1.61 

5NBT410 

0.93 

103 

60 

0.22 

0.93 

-0.82 

0.86 

-1.00 

0.00 

0.48 

1.24 

5NBT411 

1.08 

98 

73 

0.25 

1.19 

1.48 

1.17 

0.72 

0.00 

0.25 

0.72 

5NBT412 

1.49 

124 

63 

0.19 

0.87 

-2.09 

0.83 

-1.67 

0.00 

0.49 

1.53 

5NBT413 

1.12 

119 

66 

0.20 

0.97 

-0.37 

0.94 

-0.53 

0.00 

0.41 

1.11 

5NBT414 

1.71 

109 

59 

0.21 

1.12 

1.48 

1.18 

1.44 

0.00 

0.32 

0.63 

5NBT415 

1.76 

94 

40 

0.23 

0.93 

-0.85 

0.88 

-1.08 

0.00 

0.47 

1.25 

5NBT42 

0.79 

104 

66 

0.22 

1.04 

0.48 

1.08 

0.61 

0.00 

0.29 

0.86 

5NBT43 

1.38 

104 

59 

0.22 

1.05 

0.62 

0.98 

-0.11 

0.00 

0.40 

0.90 

5NBT44 

1.39 

113 

52 

0.21 

1.26 

3.32 

1.39 

3.51 

0.00 

0.14 

0.06 

5NBT45 

2.15 

95 

21 

0.26 

1.03 

0.28 

1.08 

0.48 

0.00 

0.27 

0.94 

5NBT46 

1.48 

102 

59 

0.22 

0.90 

-1.19 

0.81 

-1.20 

0.00 

0.51 

1.32 

5NBT47 

1.97 

113 

54 

0.20 

0.98 

-0.32 

0.98 

-0.16 

0.00 

0.38 

1.08 

5NBT48 

1.71 

101 

51 

0.22 

0.76 

-3.23 

0.74 

-2.75 

0.00 

0.63 

1.76 

5NBT49 

1.88 

102 

50 

0.22 

0.98 

-0.20 

0.96 

-0.40 

0.00 

0.41 

1.08 

5NBT51 

-0.29 

94 

80 

0.30 

0.95 

-0.20 

0.83 

-0.45 

0.00 

0.33 

1.06 

5NBT510 

0.72 

102 

64 

0.22 

0.93 

-0.83 

1.03 

0.25 

0.00 

0.44 

1.14 

5NBT511 

1.22 

97 

70 

0.25 

1.04 

0.40 

0.92 

-0.27 

0.00 

0.39 

0.96 

5NBT512 

1.18 

124 

71 

0.20 

1.04 

0.67 

1.01 

0.15 

0.00 

0.32 

0.86 

5NBT513 

0.23 

118 

86 

0.22 

0.90 

-0.98 

0.79 

-1.16 

0.00 

0.42 

1.22 

5NBT514 

0.18 

109 

88 

0.26 

0.87 

-0.86 

0.64 

-1.39 

0.00 

0.49 

1.20 

5NBT515 

0.73 

94 

60 

0.23 

0.92 

-0.99 

0.87 

-0.93 

0.00 

0.43 

1.26 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5NBT516 

1.14 

103 

58 

0.21 

0.87 

-1.86 

0.83 

-1.63 

0.00 

0.50 

1.51 

5NBT517 

-0.48 

104 

90 

0.30 

0.92 

-0.39 

0.74 

-0.50 

0.00 

0.34 

1.09 

5NBT518 

0.42 

237 

174 

0.16 

0.94 

-0.73 

0.93 

-0.48 

0.00 

0.41 

1.10 

5NBT519 

0.05 

113 

82 

0.23 

0.92 

-0.70 

0.85 

-0.87 

0.00 

0.42 

1.16 

5NBT52 

-0.02 

95 

63 

0.23 

0.87 

-1.54 

0.82 

-1.36 

0.00 

0.46 

1.39 

5NBT520 

0.65 

99 

73 

0.25 

1.00 

0.07 

0.87 

-0.44 

0.00 

0.37 

1.03 

5NBT53 

-0.14 

113 

97 

0.28 

0.84 

-0.88 

0.62 

-1.44 

0.00 

0.46 

1.18 

5NBT54 

0.81 

101 

69 

0.23 

0.92 

-0.76 

0.88 

-0.77 

0.00 

0.47 

1.17 

5NBT55 

0.20 

99 

80 

0.27 

0.96 

-0.22 

0.99 

0.04 

0.00 

0.34 

1.04 

5NBT56 

0.64 

94 

67 

0.24 

0.89 

-1.01 

0.77 

-1.35 

0.00 

0.47 

1.26 

5NBT57 

0.72 

101 

63 

0.22 

1.16 

1.86 

1.48 

2.60 

0.00 

0.21 

0.42 

5NBT58 

1.69 

97 

62 

0.24 

0.95 

-0.45 

0.95 

-0.24 

0.00 

0.47 

1.10 

5NBT59 

0.63 

124 

85 

0.21 

0.98 

-0.25 

0.99 

-0.01 

0.00 

0.33 

1.05 

5NBT61 

1.81 

118 

49 

0.21 

1.27 

3.16 

1.40 

3.30 

0.00 

0.18 

0.18 

5NBT610 

0.86 

108 

76 

0.23 

1.10 

0.93 

1.26 

1.35 

0.00 

0.30 

0.78 

5NBT611 

0.84 

94 

58 

0.23 

1.07 

0.91 

1.02 

0.20 

0.00 

0.30 

0.81 

5NBT612 

1.23 

103 

56 

0.21 

1.00 

0.06 

0.97 

-0.28 

0.00 

0.37 

1.02 

5NBT613 

0.44 

104 

77 

0.24 

0.98 

-0.12 

0.89 

-0.33 

0.00 

0.38 

1.04 

5NBT614 

1.33 

112 

53 

0.21 

1.02 

0.24 

1.00 

0.03 

0.00 

0.39 

0.96 

5NBT615 

0.03 

95 

62 

0.23 

0.86 

-1.73 

0.80 

-1.55 

0.00 

0.48 

1.45 

5NBT62 

1.52 

99 

57 

0.23 

0.85 

-1.91 

0.85 

-0.94 

0.00 

0.54 

1.41 

5NBT63 

0.33 

113 

90 

0.24 

0.93 

-0.48 

0.76 

-1.14 

0.00 

0.40 

1.13 

5NBT64 

0.62 

99 

71 

0.24 

0.85 

-1.31 

0.74 

-1.54 

0.00 

0.53 

1.28 

5NBT65 

1.56 

98 

55 

0.22 

1.05 

0.60 

1.06 

0.57 

0.00 

0.33 

0.83 

5NBT66 

1.39 

94 

53 

0.22 

1.03 

0.40 

0.99 

-0.09 

0.00 

0.36 

0.94 

5NBT67 

2.35 

101 

31 

0.24 

0.96 

-0.32 

0.95 

-0.27 

0.00 

0.48 

1.07 

5NBT68 

2.59 

97 

45 

0.23 

1.14 

1.46 

1.23 

1.61 

0.00 

0.35 

0.64 

5NBT69 

1.30 

124 

68 

0.19 

0.92 

-1.24 

0.88 

-1.04 

0.00 

0.43 

1.33 

5NF21 

1.70 

117 

51 

0.21 

0.88 

-1.63 

0.84 

-1.56 

0.00 

0.51 

1.38 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5NF210 

1.55 

108 

62 

0.22 

0.72 

-3.68 

0.72 

-2.32 

0.00 

0.66 

1.72 

5NF211 

1.15 

94 

52 

0.23 

0.93 

-0.88 

0.87 

-1.16 

0.00 

0.45 

1.29 

5NF212 

1.24 

102 

55 

0.21 

1.00 

0.08 

1.08 

0.76 

0.00 

0.35 

0.95 

5NF213 

1.08 

104 

65 

0.22 

0.98 

-0.21 

0.98 

-0.07 

0.00 

0.42 

1.05 

5NF214 

0.77 

112 

66 

0.21 

0.84 

-2.18 

0.80 

-1.94 

0.00 

0.53 

1.50 

5NF215 

1.83 

95 

26 

0.24 

1.08 

0.69 

1.21 

1.31 

0.00 

0.20 

0.81 

5NF22 

2.77 

99 

33 

0.24 

1.14 

1.23 

1.39 

2.18 

0.00 

0.31 

0.65 

5NF23 

2.43 

113 

43 

0.21 

1.10 

1.31 

1.16 

1.48 

0.00 

0.23 

0.67 

5NF24 

0.57 

99 

72 

0.24 

0.78 

-2.03 

0.63 

-2.27 

0.00 

0.61 

1.41 

5NF25 

0.56 

97 

73 

0.25 

0.85 

-1.24 

0.66 

-1.83 

0.00 

0.52 

1.30 

5NF26 

1.13 

94 

58 

0.23 

0.77 

-2.91 

0.70 

-2.57 

0.00 

0.61 

1.71 

5NF27 

1.22 

100 

52 

0.22 

0.99 

-0.06 

0.97 

-0.22 

0.00 

0.43 

1.03 

5NF28 

0.15 

97 

84 

0.32 

0.87 

-0.61 

0.92 

-0.04 

0.00 

0.40 

1.11 

5NF29 

1.56 

124 

61 

0.19 

0.94 

-0.88 

0.91 

-0.83 

0.00 

0.43 

1.24 

5NF31 

1.33 

117 

60 

0.20 

1.24 

3.11 

1.55 

4.64 

0.00 

0.18 

0.07 

5NF310 

1.12 

108 

71 

0.22 

0.89 

-1.12 

0.90 

-0.61 

0.00 

0.50 

1.22 

5NF311 

1.04 

94 

54 

0.23 

1.02 

0.30 

1.00 

0.05 

0.00 

0.35 

0.94 

5NF312 

1.98 

102 

39 

0.22 

1.02 

0.28 

1.00 

0.01 

0.00 

0.36 

0.96 

5NF313 

0.88 

104 

69 

0.23 

0.99 

-0.09 

0.92 

-0.36 

0.00 

0.41 

1.05 

5NF314 

1.46 

112 

50 

0.21 

1.01 

0.16 

0.99 

-0.09 

0.00 

0.40 

0.99 

5NF315 

1.19 

95 

38 

0.22 

1.09 

1.17 

1.07 

0.67 

0.00 

0.24 

0.71 

5NF316 

1.52 

99 

57 

0.23 

0.84 

-1.99 

0.81 

-1.21 

0.00 

0.55 

1.45 

5NF317 

2.42 

112 

43 

0.21 

1.02 

0.29 

1.02 

0.27 

0.00 

0.34 

0.94 

5NF318 

2.40 

99 

36 

0.23 

1.12 

1.33 

1.19 

1.35 

0.00 

0.26 

0.66 

5NF319 

1.59 

97 

54 

0.22 

1.01 

0.14 

0.99 

-0.08 

0.00 

0.38 

0.98 

5NF32 

1.31 

205 

111 

0.15 

1.10 

1.81 

1.22 

2.48 

0.00 

0.29 

0.61 

5NF320 

1.29 

229 

139 

0.15 

0.91 

-1.82 

0.88 

-1.22 

0.00 

0.46 

1.28 

5NF33 

0.46 

94 

70 

0.25 

0.87 

-1.09 

0.74 

-1.38 

0.00 

0.48 

1.26 

5NF34 

1.58 

99 

44 

0.23 

0.96 

-0.45 

1.21 

1.64 

0.00 

0.44 

1.02 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5NF35 

1.09 

97 

72 

0.25 

0.88 

-1.02 

0.72 

-1.11 

0.00 

0.50 

1.23 

5NF36 

1.22 

123 

69 

0.20 

1.06 

0.98 

1.06 

0.54 

0.00 

0.29 

0.75 

5NF37 

0.65 

117 

76 

0.21 

0.91 

-1.18 

0.94 

-0.37 

0.00 

0.42 

1.23 

5NF38 

1.44 

106 

63 

0.22 

1.02 

0.21 

0.97 

-0.16 

0.00 

0.42 

0.98 

5NF39 

1.20 

94 

51 

0.23 

1.04 

0.60 

1.03 

0.32 

0.00 

0.34 

0.85 

5NF41 

2.39 

102 

31 

0.23 

1.11 

0.99 

1.13 

0.88 

0.00 

0.26 

0.80 

5NF410 

-0.08 

104 

85 

0.27 

1.02 

0.19 

1.34 

0.98 

0.00 

0.25 

0.92 

5NF411 

1.59 

112 

47 

0.21 

1.06 

0.75 

1.06 

0.61 

0.00 

0.35 

0.83 

5NF412 

0.14 

94 

59 

0.22 

1.11 

1.44 

1.14 

1.12 

0.00 

0.16 

0.58 

5NF413 

1.48 

225 

110 

0.15 

1.16 

2.80 

1.23 

2.53 

0.00 

0.29 

0.48 

5NF414 

2.18 

99 

44 

0.23 

1.12 

1.30 

1.16 

1.14 

0.00 

0.35 

0.68 

5NF415 

3.13 

112 

28 

0.23 

1.18 

1.49 

1.43 

2.32 

0.00 

0.09 

0.65 

5NF42 

1.95 

99 

45 

0.22 

1.33 

3.67 

1.46 

3.73 

0.00 

0.07 

-0.10 

5NF43 

1.60 

96 

53 

0.22 

1.11 

1.37 

1.08 

0.79 

0.00 

0.28 

0.65 

5NF44 

1.99 

94 

41 

0.23 

1.26 

2.95 

1.35 

3.05 

0.00 

0.10 

0.11 

5NF45 

1.53 

99 

45 

0.22 

1.10 

1.14 

1.07 

0.60 

0.00 

0.36 

0.75 

5NF46 

1.63 

97 

63 

0.24 

0.85 

-1.52 

0.72 

-1.59 

0.00 

0.56 

1.37 

5NF47 

1.53 

123 

61 

0.20 

0.86 

-2.31 

0.81 

-1.93 

0.00 

0.50 

1.59 

5NF48 

1.07 

116 

66 

0.20 

0.90 

-1.44 

0.84 

-1.46 

0.00 

0.47 

1.38 

5NF49 

1.14 

106 

69 

0.23 

0.88 

-1.26 

0.79 

-1.34 

0.00 

0.53 

1.29 

5NF51 

2.42 

93 

28 

0.25 

1.27 

2.14 

1.47 

2.55 

0.00 

0.15 

0.46 

5NF510 

2.08 

102 

37 

0.22 

1.16 

1.74 

1.21 

1.70 

0.00 

0.20 

0.57 

5NF511 

-0.29 

226 

194 

0.20 

0.89 

-0.87 

0.65 

-1.81 

0.00 

0.44 

1.14 

5NF512 

-0.48 

104 

90 

0.30 

0.83 

-0.90 

0.51 

-1.22 

0.00 

0.44 

1.20 

5NF513 

1.54 

112 

48 

0.21 

1.33 

3.93 

1.44 

3.74 

0.00 

0.09 

-0.06 

5NF514 

-0.07 

94 

63 

0.23 

1.08 

0.93 

1.36 

2.29 

0.00 

0.16 

0.70 

5NF515 

1.95 

98 

48 

0.23 

0.95 

-0.53 

0.92 

-0.55 

0.00 

0.49 

1.14 

5NF516 

3.08 

112 

29 

0.23 

0.92 

-0.71 

0.95 

-0.23 

0.00 

0.42 

1.12 

5NF517 

1.01 

99 

64 

0.23 

1.06 

0.67 

1.10 

0.72 

0.00 

0.33 

0.84 



easyCBM CCSS Fifth Grade Math Measure Development 


216 

Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5NF518 

0.69 

96 

70 

0.25 

0.97 

-0.24 

1.22 

1.15 

0.00 

0.34 

0.99 

5NF519 

0.12 

94 

75 

0.27 

1.09 

0.62 

1.37 

1.42 

0.00 

0.18 

0.85 

5NF52 

1.19 

99 

52 

0.22 

1.11 

1.36 

1.23 

1.69 

0.00 

0.30 

0.58 

5NF520 

2.97 

225 

68 

0.16 

1.06 

0.75 

1.21 

1.62 

0.00 

0.40 

0.86 

5NF53 

1.63 

97 

63 

0.24 

1.10 

1.05 

1.16 

0.86 

0.00 

0.34 

0.75 

5NF54 

2.79 

122 

31 

0.23 

1.05 

0.44 

1.12 

0.72 

0.00 

0.34 

0.90 

5NF55 

2.80 

116 

28 

0.24 

1.29 

2.10 

1.86 

3.57 

0.00 

0.13 

0.49 

5NF56 

1.95 

105 

52 

0.22 

0.97 

-0.33 

0.94 

-0.46 

0.00 

0.47 

1.09 

5NF57 

1.27 

93 

49 

0.23 

1.02 

0.23 

0.98 

-0.13 

0.00 

0.38 

0.97 

5NF58 

1.74 

102 

44 

0.22 

1.16 

1.93 

1.17 

1.59 

0.00 

0.22 

0.49 

5NF59 

1.42 

104 

58 

0.22 

0.93 

-0.79 

0.87 

-0.87 

0.00 

0.49 

1.21 

5NF61 

0.81 

112 

65 

0.21 

1.18 

2.19 

1.18 

1.63 

0.00 

0.23 

0.46 

5NF610 

0.82 

94 

45 

0.22 

0.93 

-1.14 

0.93 

-0.82 

0.00 

0.41 

1.35 

5NF611 

1.55 

98 

56 

0.23 

0.93 

-0.83 

0.84 

-1.01 

0.00 

0.49 

1.25 

5NF612 

3.19 

112 

27 

0.23 

1.13 

1.10 

1.30 

1.60 

0.00 

0.15 

0.76 

5NF613 

3.14 

99 

23 

0.25 

1.29 

2.10 

1.84 

3.12 

0.00 

-0.02 

0.44 

5NF614 

2.76 

95 

30 

0.24 

1.23 

2.14 

1.40 

2.41 

0.00 

0.11 

0.45 

5NF615 

1.94 

94 

42 

0.22 

1.24 

2.83 

1.27 

2.46 

0.00 

0.13 

0.18 

5NF62 

1.33 

99 

49 

0.22 

0.96 

-0.45 

0.93 

-0.53 

0.00 

0.46 

1.13 

5NF63 

3.56 

97 

28 

0.25 

1.38 

2.80 

1.69 

2.83 

0.00 

0.13 

0.34 

5NF64 

1.67 

119 

55 

0.20 

1.05 

0.69 

1.01 

0.15 

0.00 

0.34 

0.86 

5NF65 

0.45 

116 

80 

0.22 

0.94 

-0.62 

0.86 

-0.85 

0.00 

0.40 

1.16 

5NF66 

1.98 

104 

51 

0.22 

1.09 

1.04 

1.08 

0.66 

0.00 

0.37 

0.77 

5NF67 

1.07 

93 

53 

0.23 

0.99 

-0.14 

0.95 

-0.39 

0.00 

0.39 

1.07 

5NF68 

1.77 

101 

43 

0.22 

0.99 

-0.08 

1.01 

0.15 

0.00 

0.38 

1.01 

5NF69 

1.08 

102 

64 

0.23 

1.04 

0.51 

0.96 

-0.14 

0.00 

0.39 

0.92 

5NF71 

1.68 

112 

45 

0.21 

0.93 

-0.87 

0.92 

-0.71 

0.00 

0.46 

1.20 

5NF710 

1.26 

94 

36 

0.23 

1.05 

0.60 

1.06 

0.56 

0.00 

0.27 

0.84 

5NF711 

2.11 

98 

45 

0.23 

0.87 

-1.50 

0.81 

-1.40 

0.00 

0.56 

1.36 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5NF712 

2.55 

112 

40 

0.21 

1.30 

3.33 

1.39 

3.09 

0.00 

0.01 

0.16 

5NF713 

1.66 

99 

51 

0.22 

0.88 

-1.58 

0.86 

-1.34 

0.00 

0.53 

1.39 

5NF714 

1.47 

95 

55 

0.23 

1.08 

1.02 

1.10 

0.88 

0.00 

0.29 

0.72 

5NF715 

1.69 

94 

47 

0.22 

1.18 

2.24 

1.28 

2.58 

0.00 

0.18 

0.29 

5NF72 

1.33 

99 

49 

0.22 

0.91 

-1.06 

0.89 

-0.84 

0.00 

0.50 

1.26 

5NF73 

1.96 

97 

57 

0.23 

0.99 

-0.12 

0.93 

-0.38 

0.00 

0.46 

1.06 

5NF74 

1.47 

119 

60 

0.20 

0.98 

-0.37 

0.99 

-0.05 

0.00 

0.38 

1.08 

5NF75 

0.55 

116 

78 

0.21 

1.03 

0.39 

1.03 

0.25 

0.00 

0.32 

0.92 

5NF76 

0.25 

104 

83 

0.26 

0.89 

-0.71 

0.86 

-0.42 

0.00 

0.44 

1.12 

5NF77 

0.96 

93 

55 

0.23 

1.10 

1.27 

1.06 

0.51 

0.00 

0.29 

0.70 

5NF78 

2.98 

101 

21 

0.26 

1.10 

0.68 

1.32 

1.43 

0.00 

0.23 

0.85 

5NF79 

0.98 

102 

66 

0.23 

1.01 

0.09 

0.92 

-0.34 

0.00 

0.41 

1.01 

50A11 

-0.15 

112 

85 

0.24 

0.82 

-1.59 

0.76 

-1.25 

0.00 

0.49 

1.28 

5OA110 

-0.07 

94 

63 

0.23 

0.98 

-0.21 

0.95 

-0.33 

0.00 

0.32 

1.07 

50A111 

3.20 

98 

26 

0.26 

0.95 

-0.31 

1.15 

0.74 

0.00 

0.45 

1.00 

50A112 

1.25 

112 

71 

0.21 

0.85 

-1.95 

0.80 

-1.76 

0.00 

0.51 

1.46 

50A113 

1.95 

99 

45 

0.22 

1.29 

3.31 

1.53 

4.20 

0.00 

0.09 

-0.04 

50A114 

0.65 

95 

70 

0.25 

0.94 

-0.49 

0.88 

-0.59 

0.00 

0.41 

1.11 

50A115 

1.53 

205 

102 

0.15 

0.96 

-0.72 

0.92 

-0.96 

0.00 

0.46 

1.15 

50A116 

0.01 

226 

173 

0.17 

1.02 

0.24 

0.89 

-0.60 

0.00 

0.34 

1.01 

50A117 

1.46 

93 

51 

0.23 

0.99 

-0.05 

0.95 

-0.45 

0.00 

0.40 

1.06 

50A118 

-0.71 

236 

208 

0.21 

0.89 

-0.79 

0.65 

-1.37 

0.00 

0.38 

1.12 

50A119 

1.33 

99 

49 

0.22 

0.83 

-2.09 

0.79 

-1.73 

0.00 

0.57 

1.50 

50A12 

0.82 

97 

76 

0.27 

0.90 

-0.68 

0.72 

-0.93 

0.00 

0.46 

1.16 

5OA120 

1.65 

118 

55 

0.20 

1.19 

2.69 

1.23 

2.15 

0.00 

0.19 

0.24 

50A121 

2.67 

227 

75 

0.15 

1.02 

0.37 

1.10 

1.02 

0.00 

0.37 

0.92 

50A122 

1.78 

116 

49 

0.21 

1.02 

0.31 

1.01 

0.14 

0.00 

0.40 

0.94 

50A123 

2.33 

103 

43 

0.22 

0.86 

-1.62 

0.82 

-1.41 

0.00 

0.55 

1.36 

50A124 

1.90 

93 

37 

0.23 

1.07 

0.81 

1.09 

0.79 

0.00 

0.34 

0.79 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50A125 

0.36 

100 

72 

0.24 

0.91 

-0.85 

0.78 

-1.23 

0.00 

0.43 

1.23 

50A126 

1.64 

101 

52 

0.22 

1.06 

0.77 

1.22 

1.49 

0.00 

0.38 

0.77 

50A127 

-0.10 

112 

84 

0.23 

0.79 

-1.95 

0.66 

-1.95 

0.00 

0.53 

1.36 

50A128 

0.43 

94 

53 

0.22 

0.92 

-1.29 

0.88 

-1.16 

0.00 

0.43 

1.42 

50A129 

0.67 

98 

72 

0.25 

0.80 

-1.88 

0.62 

-1.61 

0.00 

0.53 

1.41 

50A13 

2.66 

111 

37 

0.22 

1.07 

0.80 

1.26 

1.97 

0.00 

0.24 

0.75 

5OA130 

2.10 

99 

42 

0.22 

1.08 

1.01 

1.11 

0.98 

0.00 

0.32 

0.74 

50A131 

1.52 

95 

54 

0.22 

1.03 

0.34 

0.98 

-0.11 

0.00 

0.37 

0.95 

50A132 

0.88 

93 

62 

0.24 

0.83 

-1.88 

0.74 

-1.82 

0.00 

0.54 

1.45 

50A133 

0.79 

99 

60 

0.22 

0.96 

-0.52 

0.89 

-0.70 

0.00 

0.44 

1.16 

50A134 

2.01 

97 

56 

0.23 

1.03 

0.31 

0.94 

-0.32 

0.00 

0.44 

0.98 

50A14 

2.61 

118 

33 

0.22 

1.21 

1.81 

1.29 

1.81 

0.00 

0.20 

0.64 

50A15 

0.98 

116 

68 

0.21 

0.99 

-0.13 

1.06 

0.58 

0.00 

0.37 

0.99 

50A16 

2.79 

103 

34 

0.23 

1.39 

3.43 

1.70 

3.51 

0.00 

0.06 

0.12 

50A17 

-0.24 

93 

75 

0.28 

0.95 

-0.29 

1.22 

0.86 

0.00 

0.29 

1.02 

50A18 

2.60 

100 

27 

0.24 

1.13 

1.07 

1.16 

0.96 

0.00 

0.23 

0.79 

50A19 

1.67 

100 

51 

0.22 

1.02 

0.30 

1.06 

0.44 

0.00 

0.41 

0.90 

50A21 

0.90 

112 

63 

0.21 

1.13 

1.73 

1.25 

2.24 

0.00 

0.25 

0.50 

5OA210 

-0.07 

94 

63 

0.23 

1.01 

0.15 

0.96 

-0.26 

0.00 

0.29 

1.00 

50A211 

2.42 

97 

39 

0.23 

1.06 

0.62 

1.03 

0.29 

0.00 

0.42 

0.88 

50A212 

0.41 

111 

87 

0.24 

0.85 

-1.15 

0.71 

-1.50 

0.00 

0.48 

1.23 

50A213 

1.90 

99 

46 

0.22 

1.27 

3.07 

1.32 

2.73 

0.00 

0.14 

0.13 

50A214 

2.27 

95 

39 

0.23 

1.02 

0.24 

1.02 

0.24 

0.00 

0.36 

0.94 

50A215 

0.13 

93 

74 

0.27 

0.97 

-0.16 

0.93 

-0.19 

0.00 

0.34 

1.05 

50A216 

0.42 

99 

67 

0.23 

1.00 

0.04 

0.90 

-0.44 

0.00 

0.38 

1.04 

50A217 

1.28 

97 

69 

0.25 

1.02 

0.24 

1.12 

0.56 

0.00 

0.37 

0.92 

50A218 

0.70 

225 

164 

0.16 

0.92 

-1.17 

0.78 

-1.40 

0.00 

0.44 

1.19 

50A219 

1.69 

118 

54 

0.20 

0.96 

-0.60 

0.96 

-0.35 

0.00 

0.41 

1.14 

50A22 

1.52 

205 

98 

0.15 

0.95 

-0.88 

0.93 

-1.01 

0.00 

0.43 

1.18 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

5OA220 

0.41 

116 

81 

0.22 

1.01 

0.13 

0.97 

-0.12 

0.00 

0.33 

0.99 

50A221 

1.20 

103 

66 

0.23 

1.02 

0.20 

0.94 

-0.35 

0.00 

0.42 

1.00 

50A222 

0.17 

93 

69 

0.25 

0.89 

-0.94 

0.73 

-1.35 

0.00 

0.43 

1.25 

50A223 

1.62 

100 

46 

0.22 

0.94 

-0.76 

0.92 

-0.79 

0.00 

0.44 

1.22 

50A224 

1.32 

100 

58 

0.23 

1.08 

0.91 

1.31 

1.77 

0.00 

0.35 

0.73 

50A225 

0.07 

111 

80 

0.23 

0.89 

-1.02 

0.90 

-0.53 

0.00 

0.43 

1.18 

50A226 

-0.18 

94 

65 

0.23 

0.97 

-0.30 

0.94 

-0.37 

0.00 

0.33 

1.09 

50A227 

1.42 

97 

58 

0.23 

1.11 

1.23 

1.25 

1.38 

0.00 

0.31 

0.65 

50A228 

1.08 

111 

74 

0.21 

0.96 

-0.41 

0.99 

0.00 

0.00 

0.36 

1.06 

50A229 

0.62 

99 

71 

0.24 

0.89 

-0.97 

0.79 

-1.24 

0.00 

0.50 

1.22 

50A23 

0.89 

95 

66 

0.24 

1.25 

2.30 

1.30 

1.72 

0.00 

0.10 

0.47 

5OA230 

0.27 

93 

72 

0.26 

0.84 

-1.20 

0.71 

-1.33 

0.00 

0.49 

1.26 

50A231 

-0.57 

224 

199 

0.22 

0.89 

-0.66 

0.69 

-1.29 

0.00 

0.39 

1.10 

50A232 

1.90 

99 

38 

0.23 

1.21 

1.95 

1.22 

1.57 

0.00 

0.27 

0.56 

50A233 

1.91 

97 

58 

0.23 

0.96 

-0.36 

0.89 

-0.63 

0.00 

0.48 

1.11 

50A24 

0.41 

118 

85 

0.22 

0.93 

-0.72 

0.84 

-0.82 

0.00 

0.37 

1.17 

50A25 

1.19 

116 

63 

0.20 

0.92 

-1.12 

0.88 

-1.10 

0.00 

0.46 

1.29 

50A26 

2.28 

103 

44 

0.22 

1.00 

0.05 

1.04 

0.34 

0.00 

0.43 

0.97 

50A27 

2.12 

93 

33 

0.24 

1.44 

3.82 

1.77 

4.67 

0.00 

-0.02 

-0.12 

50A28 

1.15 

100 

56 

0.22 

0.99 

-0.10 

0.96 

-0.33 

0.00 

0.37 

1.05 

50A29 

1.27 

100 

59 

0.23 

1.09 

1.03 

1.19 

1.11 

0.00 

0.34 

0.71 

50A31 

0.80 

205 

110 

0.15 

1.03 

0.57 

1.01 

0.10 

0.00 

0.35 

0.91 

5OA310 

2.00 

222 

86 

0.15 

1.04 

0.71 

1.12 

1.22 

0.00 

0.39 

0.86 

50A311 

1.28 

205 

89 

0.15 

1.05 

0.85 

1.05 

0.76 

0.00 

0.34 

0.84 

50A312 

1.68 

97 

53 

0.23 

1.20 

2.20 

1.22 

1.37 

0.00 

0.28 

0.44 

50A313 

2.43 

110 

42 

0.21 

1.20 

2.42 

1.35 

3.00 

0.00 

0.11 

0.32 

50A314 

1.56 

99 

53 

0.22 

0.97 

-0.29 

0.98 

-0.13 

0.00 

0.43 

1.07 

50A315 

2.17 

95 

41 

0.22 

1.00 

0.02 

1.03 

0.32 

0.00 

0.38 

0.98 

50A316 

2.23 

93 

36 

0.23 

0.93 

-0.74 

0.90 

-0.84 

0.00 

0.46 

1.20 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

50A317 

1.19 

99 

52 

0.22 

0.95 

-0.54 

1.01 

0.12 

0.00 

0.45 

1.10 

50A318 

1.22 

97 

70 

0.25 

0.86 

-1.22 

0.72 

-1.22 

0.00 

0.52 

1.27 

50A319 

0.41 

118 

85 

0.22 

0.90 

-1.05 

0.79 

-1.11 

0.00 

0.40 

1.24 

50A32 

1.07 

116 

66 

0.20 

1.23 

3.01 

1.26 

2.18 

0.00 

0.19 

0.21 

5OA320 

1.50 

103 

60 

0.22 

1.13 

1.40 

1.09 

0.68 

0.00 

0.34 

0.70 

50A321 

1.43 

93 

46 

0.23 

0.99 

-0.04 

0.96 

-0.35 

0.00 

0.40 

1.05 

50A322 

1.01 

100 

59 

0.22 

0.86 

-1.98 

0.80 

-1.75 

0.00 

0.51 

1.54 

50A323 

0.33 

100 

76 

0.25 

1.07 

0.60 

1.35 

1.19 

0.00 

0.26 

0.82 

50A324 

0.37 

111 

74 

0.22 

0.87 

-1.51 

0.78 

-1.62 

0.00 

0.49 

1.34 

50A325 

0.53 

94 

51 

0.22 

0.95 

-0.83 

0.91 

-0.93 

0.00 

0.39 

1.30 

50A326 

2.10 

97 

45 

0.23 

1.05 

0.55 

1.03 

0.23 

0.00 

0.42 

0.89 

50A327 

1.62 

222 

119 

0.15 

1.02 

0.44 

1.08 

1.17 

0.00 

0.36 

0.90 

50A328 

3.46 

110 

22 

0.25 

1.01 

0.14 

1.18 

0.86 

0.00 

0.27 

0.94 

50A329 

2.10 

99 

42 

0.22 

1.00 

-0.01 

0.99 

-0.05 

0.00 

0.40 

1.02 

50 A3 3 

1.97 

95 

45 

0.22 

1.11 

1.44 

1.20 

1.85 

0.00 

0.26 

0.56 

5OA330 

2.45 

93 

32 

0.24 

1.04 

0.44 

1.21 

1.47 

0.00 

0.30 

0.82 

50A331 

2.41 

99 

29 

0.25 

1.24 

1.86 

1.31 

1.68 

0.00 

0.23 

0.61 

50A332 

3.37 

97 

31 

0.25 

1.40 

3.13 

2.02 

4.34 

0.00 

0.09 

0.15 

50A333 

2.82 

118 

29 

0.23 

1.25 

1.89 

1.35 

1.86 

0.00 

0.17 

0.64 

50 A3 4 

-1.24 

237 

219 

0.25 

0.95 

-0.22 

0.75 

-0.64 

0.00 

0.27 

1.05 

50 A3 5 

2.99 

116 

25 

0.25 

1.26 

1.74 

1.64 

2.51 

0.00 

0.19 

0.62 

50 A3 6 

2.28 

103 

44 

0.22 

1.08 

0.92 

1.03 

0.28 

0.00 

0.38 

0.83 

50 A3 7 

1.48 

93 

45 

0.23 

1.08 

0.96 

1.05 

0.53 

0.00 

0.33 

0.76 

50 A3 8 

1.29 

100 

53 

0.22 

1.08 

1.14 

1.09 

0.84 

0.00 

0.28 

0.67 

50 A3 9 

2.13 

100 

42 

0.23 

1.10 

1.03 

1.08 

0.59 

0.00 

0.39 

0.78 
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Appendix E: Distractor Statistics 


Appendix E: Distractor Statistics for Full CCSS Item Bank 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50001 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.06 

50001 

A 

1 

23 

44 

0.51 

0.30 

1.44 

0.26 

50001 

B 

0 

9 

17 

0.01 

0.32 

1.39 

-0.05 

50001 

C 

0 

13 

25 

0.05 

0.27 

1.27 

-0.05 

50001 

D 

0 

7 

13 

-0.65 

0.31 

0.62 

-0.26 

50002 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.02 

50002 

A 

1 

37 

66 

1.08 

0.20 

0.98 

0.44 

50002 

B 

0 

9 

16 

0.06 

0.38 

1.25 

-0.22 

50002 

C 

0 

8 

14 

-0.24 

0.30 

0.68 

-0.30 

50002 

D 

0 

2 

4 

-0.20 

1.26 

1.00 

-0.14 

50003 

* 

-1 

4699 

99 

0.90 

0.02 

0.00 

0.01 

50003 

A 

1 

40 

65 

1.20 

0.22 

1.48 

0.39 

50003 

B 

0 

6 

10 

-0.42 

0.40 

0.53 

-0.30 

50003 

C 

0 

4 

6 

-0.55 

0.51 

0.47 

-0.26 

50003 

D 

0 

12 

19 

0.59 

0.23 

1.33 

-0.08 

50004 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.06 

50004 

A 

1 

25 

48 

0.56 

0.22 

0.99 

0.39 

50004 

B 

0 

5 

10 

-0.35 

0.50 

0.90 

-0.15 

50004 

C 

0 

16 

31 

-0.29 

0.20 

0.89 

-0.27 

50004 

D 

0 

6 

12 

-0.12 

0.42 

1.22 

-0.09 

50005 

* 

-1 

1936 

41 

1.46 

0.03 

0.00 

0.35 

50005 

A 

1 

1519 

54 

0.94 

0.03 

1.22 

0.35 

50005 

B 

0 

670 

24 

0.16 

0.04 

1.36 

-0.15 

50005 

C 

0 

428 

15 

0.07 

0.05 

1.25 

-0.15 

50005 

D 

0 

208 

7 

-0.52 

0.10 

0.87 

-0.22 

50006 

* 

-1 

4701 

99 

0.90 

0.02 

0.00 

0.01 

50006 

A 

1 

52 

87 

0.93 

0.20 

1.21 

0.32 

50006 

B 

0 

6 

10 

-0.53 

0.27 

0.65 

-0.30 

50006 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50006 

D 

0 

2 

3 

-0.09 

0.98 

1.28 

-0.11 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50007 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50007 

A 

1 

46 

94 

0.23 

0.17 

0.93 

0.32 

50007 

B 

0 

3 

6 

-1.36 

0.22 

0.38 

-0.32 

50007 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50007 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50008 

* 

-1 

4702 

99 

0.90 

0.02 

0.00 

0.01 

50008 

A 

1 

53 

90 

0.99 

0.20 

0.90 

0.38 

50008 

B 

0 

3 

5 

-0.08 

0.93 

2.23 

-0.13 

50008 

C 

0 

1 

2 

-1.50 

0.00 

0.23 

-0.20 

50008 

D 

0 

2 

3 

-1.97 

0.48 

0.16 

-0.34 

50009 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

0.01 

50009 

A 

1 

55 

87 

0.92 

0.18 

1.15 

0.27 

50009 

B 

0 

6 

10 

-0.35 

0.33 

0.80 

-0.28 

50009 

C 

0 

2 

3 

0.42 

0.14 

1.25 

-0.05 

50009 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50010 

* 

-1 

4693 

99 

0.90 

0.02 

0.00 

0.00 

50010 

A 

1 

58 

85 

0.94 

0.16 

1.14 

0.10 

50010 

B 

0 

1 

1 

3.09 

0.00 

14.45 

0.22 

50010 

C 

0 

8 

12 

0.35 

0.39 

1.81 

-0.16 

50010 

D 

0 

1 

1 

0.13 

0.00 

0.75 

-0.07 

50011 

* 

-1 

4702 

99 

0.90 

0.02 

0.00 

0.01 

50011 

A 

1 

45 

76 

1.28 

0.19 

0.71 

0.61 

50011 

B 

0 

8 

14 

-0.67 

0.31 

0.57 

-0.38 

50011 

C 

0 

2 

3 

-1.88 

0.43 

0.13 

-0.33 

50011 

D 

0 

4 

7 

-0.81 

0.53 

0.50 

-0.28 

50012 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.02 

50012 

A 

1 

50 

86 

0.83 

0.18 

0.91 

0.37 

50012 

B 

0 

6 

10 

-0.68 

0.44 

0.62 

-0.34 

50012 

C 

0 

1 

2 

0.32 

0.00 

1.21 

-0.03 

50012 

D 

0 

1 

2 

-0.96 

0.00 

0.33 

-0.16 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50013 

* 

-1 

1948 

41 

1.46 

0.03 

0.00 

0.34 

50013 

A 

1 

1689 

60 

1.05 

0.03 

0.93 

0.50 

50013 

B 

0 

409 

15 

-0.11 

0.04 

0.95 

-0.20 

50013 

C 

0 

411 

15 

-0.18 

0.05 

0.94 

-0.22 

50013 

D 

0 

304 

11 

-0.65 

0.07 

0.63 

-0.31 

50014 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.03 

50014 

A 

1 

39 

67 

1.00 

0.23 

0.91 

0.46 

50014 

B 

0 

10 

17 

-0.55 

0.35 

0.90 

-0.34 

50014 

C 

0 

6 

10 

-0.07 

0.40 

1.15 

-0.14 

50014 

D 

0 

3 

5 

-0.74 

0.72 

0.69 

-0.20 

50015 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.04 

50015 

A 

1 

41 

73 

0.59 

0.16 

1.10 

0.34 

50015 

B 

0 

8 

14 

-0.17 

0.23 

0.82 

-0.23 

50015 

C 

0 

2 

4 

-0.43 

0.49 

0.61 

-0.16 

50015 

D 

0 

5 

9 

-0.11 

0.31 

0.93 

-0.16 

50016 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50016 

A 

1 

36 

68 

1.25 

0.19 

0.93 

0.55 

50016 

B 

0 

5 

9 

-0.84 

0.40 

0.39 

-0.39 

50016 

C 

0 

9 

17 

0.16 

0.35 

1.17 

-0.21 

50016 

D 

0 

3 

6 

-0.71 

0.52 

0.39 

-0.27 

50017 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.01 

50017 

A 

1 

45 

82 

1.12 

0.20 

0.85 

0.50 

50017 

B 

0 

2 

4 

0.24 

1.15 

1.75 

-0.07 

50017 

C 

0 

6 

11 

-1.06 

0.29 

0.33 

-0.45 

50017 

D 

0 

2 

4 

-0.60 

0.39 

0.47 

-0.19 

50018 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50018 

A 

1 

37 

71 

1.06 

0.22 

0.83 

0.49 

50018 

B 

0 

12 

23 

-0.21 

0.30 

1.14 

-0.32 

50018 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50018 

D 

0 

3 

6 

-1.61 

0.45 

0.19 

-0.38 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50019 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

50019 

A 

1 

32 

67 

1.23 

0.22 

0.74 

0.58 

50019 

B 

0 

6 

13 

-0.41 

0.42 

0.71 

-0.31 

50019 

C 

0 

4 

8 

-0.08 

0.14 

0.67 

-0.17 

50019 

D 

0 

6 

13 

-0.62 

0.17 

0.41 

-0.37 

50020 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50020 

A 

1 

35 

71 

0.47 

0.20 

1.06 

0.45 

50020 

B 

0 

1 

2 

1.09 

0.00 

3.39 

0.12 

50020 

C 

0 

3 

6 

-0.86 

0.42 

0.58 

-0.21 

50020 

D 

0 

10 

20 

-0.86 

0.18 

0.55 

-0.42 

50021 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

0.01 

50021 

A 

1 

26 

41 

1.88 

0.27 

0.85 

0.64 

50021 

B 

0 

7 

11 

0.13 

0.30 

0.63 

-0.17 

50021 

C 

0 

9 

14 

0.15 

0.21 

0.62 

-0.20 

50021 

D 

0 

21 

33 

0.02 

0.21 

0.65 

-0.41 

50022 

* 

-1 

4702 

99 

0.90 

0.02 

0.00 

0.00 

50022 

A 

1 

31 

53 

1.52 

0.21 

0.89 

0.53 

50022 

B 

0 

6 

10 

0.70 

0.30 

1.14 

-0.05 

50022 

C 

0 

9 

15 

0.30 

0.44 

1.94 

-0.20 

50022 

D 

0 

13 

22 

-0.13 

0.21 

0.50 

-0.43 

50023 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.01 

50023 

A 

1 

30 

53 

1.68 

0.23 

0.71 

0.63 

50023 

B 

0 

7 

12 

0.24 

0.42 

1.26 

-0.14 

50023 

C 

0 

6 

11 

-0.08 

0.49 

0.92 

-0.21 

50023 

D 

0 

14 

25 

-0.42 

0.23 

0.46 

-0.48 

50024 

* 

-1 

4697 

99 

0.90 

0.02 

0.00 

0.00 

50024 

A 

1 

27 

42 

1.83 

0.28 

1.05 

0.56 

50024 

B 

0 

9 

14 

0.25 

0.30 

0.76 

-0.17 

50024 

C 

0 

14 

22 

0.74 

0.29 

1.50 

-0.04 

50024 

D 

0 

14 

22 

-0.49 

0.23 

0.36 

-0.48 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50025 

* 

-1 

4697 

99 

0.90 

0.02 

0.00 

0.01 

50025 

A 

1 

43 

67 

1.37 

0.21 

0.89 

0.55 

50025 

B 

0 

8 

13 

-0.30 

0.37 

0.76 

-0.29 

50025 

C 

0 

5 

8 

-0.06 

0.34 

0.78 

-0.17 

50025 

D 

0 

8 

13 

-0.54 

0.36 

0.59 

-0.35 

50026 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

50026 

A 

1 

34 

62 

1.37 

0.27 

1.00 

0.57 

50026 

B 

0 

7 

13 

-0.45 

0.29 

0.57 

-0.27 

50026 

C 

0 

5 

9 

-0.29 

0.33 

0.70 

-0.19 

50026 

D 

0 

9 

16 

-0.56 

0.26 

0.53 

-0.35 

50027 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.04 

50027 

A 

1 

35 

61 

0.86 

0.19 

1.28 

0.47 

50027 

B 

0 

5 

9 

-0.30 

0.29 

0.64 

-0.21 

50027 

C 

0 

4 

7 

-0.58 

0.39 

0.49 

-0.25 

50027 

D 

0 

13 

23 

-0.08 

0.20 

0.86 

-0.25 

50028 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50028 

A 

1 

26 

53 

0.65 

0.21 

1.10 

0.31 

50028 

B 

0 

1 

2 

-0.71 

0.00 

0.36 

-0.16 

50028 

C 

0 

11 

22 

0.46 

0.11 

1.22 

0.05 

50028 

D 

0 

11 

22 

-0.30 

0.29 

0.86 

-0.36 

50029 

* 

-1 

4715 

99 

0.91 

0.02 

0.00 

0.05 

50029 

A 

1 

34 

74 

0.66 

0.16 

0.70 

0.66 

50029 

B 

0 

2 

4 

-0.85 

0.87 

0.64 

-0.19 

50029 

C 

0 

1 

2 

-1.95 

0.00 

0.15 

-0.27 

50029 

D 

0 

9 

20 

-1.06 

0.26 

0.48 

-0.53 

50030 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.03 

50030 

A 

1 

44 

75 

0.80 

0.19 

1.04 

0.29 

50030 

B 

0 

7 

12 

-0.25 

0.46 

1.36 

-0.25 

50030 

C 

0 

1 

2 

1.43 

0.00 

3.21 

0.09 

50030 

D 

0 

7 

12 

-0.01 

0.28 

0.98 

-0.18 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50031 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

-0.01 

50031 

A 

1 

55 

87 

1.23 

0.18 

0.92 

0.45 

50031 

B 

0 

6 

10 

-0.68 

0.19 

0.39 

-0.38 

50031 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50031 

D 

0 

2 

3 

-0.75 

0.40 

0.36 

-0.22 

50032 

* 

-1 

4689 

98 

0.90 

0.02 

0.00 

-0.01 

50032 

A 

1 

58 

81 

1.30 

0.17 

0.82 

0.47 

50032 

B 

0 

6 

8 

0.09 

0.48 

1.13 

-0.19 

50032 

C 

0 

6 

8 

-0.46 

0.46 

0.80 

-0.31 

50032 

D 

0 

2 

3 

-1.25 

0.18 

0.18 

-0.27 

50033 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50033 

A 

1 

31 

62 

1.16 

0.21 

0.64 

0.68 

50033 

B 

0 

12 

24 

-0.59 

0.28 

0.75 

-0.39 

50033 

C 

0 

4 

8 

-1.37 

0.55 

0.32 

-0.36 

50033 

D 

0 

3 

6 

-1.12 

0.20 

0.29 

-0.27 

50034 

* 

-1 

4692 

99 

0.90 

0.02 

0.00 

0.01 

50034 

A 

1 

51 

74 

1.32 

0.18 

0.97 

0.54 

50034 

B 

0 

11 

16 

-0.14 

0.19 

0.66 

-0.25 

50034 

C 

0 

4 

6 

-0.74 

0.26 

0.33 

-0.24 

50034 

D 

0 

3 

4 

-2.57 

1.97 

0.43 

-0.44 

50035 

* 

-1 

4699 

99 

0.91 

0.02 

0.00 

0.03 

50035 

A 

1 

42 

68 

1.22 

0.20 

0.84 

0.63 

50035 

B 

0 

8 

13 

-1.04 

0.35 

0.50 

-0.43 

50035 

C 

0 

5 

8 

-0.63 

0.28 

0.48 

-0.25 

50035 

D 

0 

7 

11 

-0.50 

0.20 

0.53 

-0.27 

50036 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50036 

A 

1 

23 

46 

1.18 

0.24 

0.69 

0.56 

50036 

B 

0 

4 

8 

-0.84 

0.36 

0.39 

-0.28 

50036 

C 

0 

14 

28 

0.00 

0.34 

2.50 

-0.18 

50036 

D 

0 

9 

18 

-0.52 

0.22 

0.52 

-0.33 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50037 

* 

-1 

4699 

99 

0.91 

0.02 

0.00 

0.02 

50037 

A 

1 

54 

87 

0.89 

0.19 

0.92 

0.44 

50037 

B 

0 

4 

6 

-0.64 

0.20 

0.58 

-0.23 

50037 

C 

0 

3 

5 

-1.36 

0.10 

0.27 

-0.31 

50037 

D 

0 

1 

2 

-1.64 

0.00 

0.20 

-0.20 

50038 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.02 

50038 

A 

1 

49 

84 

0.85 

0.18 

1.02 

0.32 

50038 

B 

0 

5 

9 

-0.33 

0.26 

0.65 

-0.25 

50038 

C 

0 

2 

3 

0.01 

0.66 

0.98 

-0.10 

50038 

D 

0 

2 

3 

-0.28 

0.55 

0.69 

-0.14 

50039 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

50039 

A 

1 

44 

83 

0.47 

0.20 

0.93 

0.36 

50039 

B 

0 

3 

6 

-0.89 

0.99 

1.00 

-0.20 

50039 

C 

0 

3 

6 

-0.47 

0.85 

1.30 

-0.13 

50039 

D 

0 

3 

6 

-1.13 

0.24 

0.44 

-0.25 

50040 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50040 

A 

1 

41 

75 

0.96 

0.19 

0.74 

0.55 

50040 

B 

0 

3 

5 

-1.10 

0.10 

0.30 

-0.28 

50040 

C 

0 

5 

9 

-0.30 

0.72 

1.44 

-0.18 

50040 

D 

0 

6 

11 

-1.08 

0.29 

0.37 

-0.40 

50041 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50041 

A 

1 

11 

21 

1.65 

0.28 

0.59 

0.52 

50041 

B 

0 

15 

29 

0.19 

0.29 

0.99 

-0.13 

50041 

C 

0 

18 

35 

0.22 

0.26 

1.09 

-0.12 

50041 

D 

0 

8 

15 

-0.34 

0.34 

0.50 

-0.27 

50042 

* 

-1 

4697 

99 

0.90 

0.02 

0.00 

0.01 

50042 

A 

1 

28 

44 

1.24 

0.24 

1.18 

0.37 

50042 

B 

0 

9 

14 

0.85 

0.42 

1.79 

0.04 

50042 

C 

0 

19 

30 

0.33 

0.20 

0.85 

-0.22 

50042 

D 

0 

8 

13 

-0.17 

0.18 

0.44 

-0.29 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50043 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50043 

A 

1 

13 

27 

1.69 

0.51 

1.82 

0.42 

50043 

B 

0 

13 

27 

0.77 

0.24 

1.22 

0.05 

50043 

C 

0 

19 

39 

-0.05 

0.32 

1.87 

-0.38 

50043 

D 

0 

4 

8 

0.23 

0.35 

0.60 

-0.08 

50044 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50044 

A 

1 

19 

39 

2.09 

0.35 

0.75 

0.64 

50044 

B 

0 

9 

18 

-0.27 

0.39 

0.71 

-0.29 

50044 

C 

0 

13 

27 

0.32 

0.28 

1.01 

-0.15 

50044 

D 

0 

8 

16 

-0.63 

0.45 

0.51 

-0.36 

50045 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

50045 

A 

1 

36 

65 

1.12 

0.25 

1.09 

0.42 

50045 

B 

0 

9 

16 

0.24 

0.35 

1.51 

-0.13 

50045 

C 

0 

4 

7 

0.11 

0.49 

1.14 

-0.10 

50045 

D 

0 

6 

11 

-1.05 

0.21 

0.29 

-0.41 

50046 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50046 

A 

1 

25 

50 

1.28 

0.29 

0.86 

0.52 

50046 

B 

0 

13 

26 

-0.11 

0.28 

1.09 

-0.26 

50046 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50046 

D 

0 

12 

24 

-0.38 

0.31 

0.84 

-0.35 

50047 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50047 

A 

1 

33 

67 

0.98 

0.22 

0.88 

0.52 

50047 

B 

0 

4 

8 

0.00 

0.69 

1.44 

-0.11 

50047 

C 

0 

5 

10 

-0.82 

0.36 

0.46 

-0.33 

50047 

D 

0 

7 

14 

-0.60 

0.21 

0.52 

-0.33 

50048 

* 

-1 

4702 

99 

0.90 

0.02 

0.00 

0.02 

50048 

A 

1 

46 

78 

1.09 

0.16 

0.72 

0.60 

50048 

B 

0 

2 

3 

-0.97 

0.67 

0.35 

-0.24 

50048 

C 

0 

3 

5 

-0.83 

0.52 

0.40 

-0.27 

50048 

D 

0 

8 

14 

-0.68 

0.23 

0.46 

-0.42 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50049 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50049 

A 

1 

36 

75 

0.75 

0.20 

0.79 

0.50 

50049 

B 

0 

3 

6 

0.01 

1.31 

4.75 

-0.07 

50049 

C 

0 

3 

6 

-0.95 

0.48 

0.49 

-0.26 

50049 

D 

0 

6 

13 

-1.06 

0.19 

0.39 

-0.41 

50050 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50050 

A 

1 

30 

55 

1.05 

0.24 

0.93 

0.39 

50050 

B 

0 

2 

4 

-0.41 

0.80 

0.62 

-0.15 

50050 

C 

0 

17 

31 

-0.12 

0.18 

0.81 

-0.36 

50050 

D 

0 

6 

11 

0.58 

0.73 

4.42 

0.00 

50051 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50051 

A 

1 

22 

44 

1.45 

0.33 

0.91 

0.58 

50051 

B 

0 

5 

10 

-0.44 

0.40 

0.59 

-0.21 

50051 

C 

0 

10 

20 

-0.17 

0.24 

0.67 

-0.22 

50051 

D 

0 

13 

26 

-0.30 

0.31 

0.78 

-0.31 

50052 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.05 

50052 

A 

1 

18 

33 

1.11 

0.33 

1.34 

0.43 

50052 

B 

0 

9 

16 

-0.12 

0.40 

1.25 

-0.16 

50052 

C 

0 

17 

31 

0.22 

0.20 

1.00 

-0.06 

50052 

D 

0 

11 

20 

-0.38 

0.33 

0.63 

-0.29 

50053 

* 

-1 

4700 

99 

0.90 

0.02 

0.00 

0.00 

50053 

A 

1 

35 

57 

1.58 

0.24 

0.99 

0.53 

50053 

B 

0 

6 

10 

0.15 

0.45 

0.85 

-0.18 

50053 

C 

0 

8 

13 

0.82 

0.15 

1.22 

-0.03 

50053 

D 

0 

12 

20 

-0.54 

0.19 

0.35 

-0.50 

50054 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.03 

50054 

A 

1 

15 

25 

1.59 

0.22 

0.60 

0.61 

50054 

B 

0 

5 

8 

0.35 

0.29 

0.79 

-0.06 

50054 

C 

0 

24 

40 

0.17 

0.16 

0.73 

-0.31 

50054 

D 

0 

16 

27 

0.20 

0.21 

0.78 

-0.21 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50055 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50055 

A 

1 

10 

19 

2.19 

0.45 

0.74 

0.55 

50055 

B 

0 

7 

13 

0.34 

0.41 

0.73 

-0.08 

50055 

C 

0 

23 

44 

0.48 

0.25 

1.03 

-0.09 

50055 

D 

0 

12 

23 

-0.22 

0.30 

0.41 

-0.33 

50056 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.01 

50056 

A 

1 

22 

39 

1.65 

0.35 

2.26 

0.52 

50056 

B 

0 

13 

23 

-0.16 

0.22 

0.48 

-0.34 

50056 

C 

0 

8 

14 

0.59 

0.22 

0.91 

-0.04 

50056 

D 

0 

13 

23 

0.16 

0.29 

0.78 

-0.22 

50057 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.00 

50057 

A 

1 

16 

33 

2.20 

0.36 

0.83 

0.62 

50057 

B 

0 

12 

24 

0.64 

0.36 

1.36 

-0.08 

50057 

C 

0 

5 

10 

-0.14 

0.30 

0.42 

-0.22 

50057 

D 

0 

16 

33 

-0.05 

0.24 

0.58 

-0.41 

50058 

* 

-1 

4700 

99 

0.91 

0.02 

0.00 

0.02 

50058 

A 

1 

22 

36 

1.66 

0.25 

0.78 

0.62 

50058 

B 

0 

18 

30 

0.30 

0.16 

0.73 

-0.19 

50058 

C 

0 

7 

11 

0.07 

0.31 

0.62 

-0.18 

50058 

D 

0 

14 

23 

-0.13 

0.27 

0.58 

-0.36 

50059 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.04 

50059 

A 

1 

15 

26 

1.12 

0.30 

0.96 

0.40 

50059 

B 

0 

7 

12 

-0.08 

0.10 

0.52 

-0.17 

50059 

C 

0 

19 

33 

0.54 

0.22 

1.34 

0.10 

50059 

D 

0 

16 

28 

-0.25 

0.25 

0.67 

-0.37 

50060 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.05 

50060 

A 

1 

16 

28 

0.59 

0.33 

1.67 

0.17 

50060 

B 

0 

10 

18 

0.79 

0.49 

3.41 

0.20 

50060 

C 

0 

8 

14 

-0.09 

0.26 

0.71 

-0.12 

50060 

D 

0 

23 

40 

-0.07 

0.22 

0.90 

-0.22 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50061 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

50061 

A 

1 

39 

71 

1.12 

0.24 

0.95 

0.51 

50061 

B 

0 

9 

16 

-0.89 

0.28 

0.48 

-0.42 

50061 

C 

0 

1 

2 

-0.31 

0.00 

0.65 

-0.08 

50061 

D 

0 

6 

11 

-0.29 

0.54 

1.14 

-0.20 

50062 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.00 

50062 

A 

1 

53 

95 

1.00 

0.18 

1.14 

0.18 

50062 

B 

0 

1 

2 

0.00 

0.00 

0.78 

-0.10 

50062 

C 

0 

2 

4 

-0.06 

0.75 

0.96 

-0.15 

50062 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50063 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

50063 

A 

1 

40 

80 

0.95 

0.21 

1.19 

0.21 

50063 

B 

0 

1 

2 

-0.41 

0.00 

0.48 

-0.13 

50063 

C 

0 

4 

8 

1.19 

0.69 

5.43 

0.08 

50063 

D 

0 

5 

10 

-0.41 

0.70 

1.13 

-0.29 

50064 

* 

-1 

4702 

99 

0.90 

0.02 

0.00 

0.01 

50064 

A 

1 

49 

83 

0.89 

0.22 

1.16 

0.24 

50064 

B 

0 

1 

2 

-1.64 

0.00 

0.18 

-0.21 

50064 

C 

0 

2 

3 

1.27 

0.16 

3.27 

0.07 

50064 

D 

0 

7 

12 

-0.20 

0.31 

0.98 

-0.23 

50065 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.03 

50065 

A 

1 

54 

90 

0.71 

0.16 

0.85 

0.46 

50065 

B 

0 

2 

3 

-1.21 

0.21 

0.32 

-0.25 

50065 

C 

0 

2 

3 

-1.78 

0.08 

0.18 

-0.33 

50065 

D 

0 

2 

3 

-0.77 

0.24 

0.50 

-0.19 

50066 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.02 

50066 

A 

1 

51 

91 

0.79 

0.17 

1.02 

0.30 

50066 

B 

0 

2 

4 

-1.49 

0.28 

0.22 

-0.33 

50066 

C 

0 

3 

5 

0.10 

0.87 

2.17 

-0.11 

50066 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50067 

* 

-1 

4700 

99 

0.91 

0.02 

0.00 

0.03 

50067 

A 

1 

57 

93 

0.67 

0.21 

1.13 

0.24 

50067 

B 

0 

1 

2 

-1.29 

0.00 

0.39 

-0.15 

50067 

C 

0 

2 

3 

-0.81 

0.60 

0.75 

-0.16 

50067 

D 

0 

1 

2 

-0.62 

0.00 

0.76 

-0.10 

50068 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.02 

50068 

A 

1 

43 

77 

0.97 

0.21 

1.04 

0.42 

50068 

B 

0 

5 

9 

-0.88 

0.32 

0.43 

-0.34 

50068 

C 

0 

3 

5 

-0.70 

0.55 

0.53 

-0.23 

50068 

D 

0 

5 

9 

0.21 

0.39 

1.50 

-0.10 

50069 

* 

-1 

4701 

99 

0.90 

0.02 

0.00 

-0.01 

50069 

A 

1 

55 

92 

1.10 

0.16 

0.90 

0.36 

50069 

B 

0 

3 

5 

-0.15 

0.28 

0.57 

-0.21 

50069 

C 

0 

1 

2 

-1.95 

0.00 

0.09 

-0.32 

50069 

D 

0 

1 

2 

0.15 

0.00 

0.73 

-0.09 

50070 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.06 

50070 

A 

1 

46 

87 

0.36 

0.14 

0.91 

0.35 

50070 

B 

0 

1 

2 

0.27 

0.00 

1.59 

0.01 

50070 

C 

0 

1 

2 

-0.65 

0.00 

0.63 

-0.11 

50070 

D 

0 

5 

9 

-1.04 

0.79 

1.16 

-0.36 

50071 

* 

-1 

4701 

99 

0.90 

0.02 

0.00 

0.02 

50071 

A 

1 

54 

90 

0.80 

0.16 

1.05 

0.22 

50071 

B 

0 

3 

5 

-0.26 

0.07 

0.58 

-0.20 

50071 

C 

0 

1 

2 

-0.73 

0.00 

0.36 

-0.16 

50071 

D 

0 

2 

3 

0.69 

0.43 

1.64 

0.00 

50072 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.00 

50072 

A 

1 

54 

93 

0.99 

0.18 

1.02 

0.25 

50072 

B 

0 

2 

3 

-0.80 

0.41 

0.37 

-0.25 

50072 

C 

0 

2 

3 

0.23 

0.42 

1.05 

-0.10 

50072 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50073 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.01 

50073 

A 

1 

46 

88 

0.90 

0.20 

1.06 

0.26 

50073 

B 

0 

4 

8 

0.26 

0.51 

1.50 

-0.11 

50073 

C 

0 

1 

2 

-1.24 

0.00 

0.23 

-0.21 

50073 

D 

0 

1 

2 

-0.81 

0.00 

0.36 

-0.17 

50074 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.01 

50074 

A 

1 

35 

61 

1.23 

0.24 

1.17 

0.44 

50074 

B 

0 

16 

28 

0.12 

0.26 

1.06 

-0.29 

50074 

C 

0 

6 

11 

-0.31 

0.15 

0.47 

-0.27 

50074 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50075 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50075 

A 

1 

44 

88 

0.39 

0.14 

0.88 

0.44 

50075 

B 

0 

1 

2 

-0.17 

0.00 

0.99 

-0.05 

50075 

C 

0 

3 

6 

-0.86 

0.84 

0.86 

-0.26 

50075 

D 

0 

2 

4 

-1.71 

0.42 

0.23 

-0.38 

50076 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.02 

50076 

A 

1 

40 

78 

0.80 

0.20 

1.01 

0.32 

50076 

B 

0 

2 

4 

-0.52 

0.02 

0.48 

-0.18 

50076 

C 

0 

5 

10 

0.37 

0.55 

2.13 

-0.06 

50076 

D 

0 

4 

8 

-0.67 

0.35 

0.49 

-0.30 

50077 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.01 

50077 

A 

1 

41 

73 

1.20 

0.23 

1.10 

0.50 

50077 

B 

0 

4 

7 

-0.83 

0.16 

0.34 

-0.29 

50077 

C 

0 

4 

7 

0.14 

0.17 

0.91 

-0.11 

50077 

D 

0 

7 

13 

-0.67 

0.42 

0.56 

-0.35 

50078 

* 

-1 

1961 

41 

1.45 

0.03 

0.00 

0.34 

50078 

A 

1 

1586 

57 

1.08 

0.03 

0.99 

0.50 

50078 

B 

0 

229 

8 

-0.08 

0.07 

1.02 

-0.14 

50078 

C 

0 

676 

24 

-0.11 

0.03 

0.87 

-0.27 

50078 

D 

0 

309 

11 

-0.56 

0.07 

0.66 

-0.29 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50079 

* 

-1 

4698 

99 

0.91 

0.02 

0.00 

0.03 

50079 

A 

1 

38 

60 

0.93 

0.17 

0.92 

0.44 

50079 

B 

0 

11 

17 

-0.02 

0.26 

0.94 

-0.25 

50079 

C 

0 

9 

14 

0.15 

0.33 

1.11 

-0.15 

50079 

D 

0 

5 

8 

-0.32 

0.30 

0.56 

-0.24 

50080 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50080 

A 

1 

36 

71 

0.75 

0.16 

1.15 

0.31 

50080 

B 

0 

5 

10 

-0.11 

0.46 

0.79 

-0.23 

50080 

C 

0 

4 

8 

0.38 

0.20 

1.05 

-0.05 

50080 

D 

0 

6 

12 

0.08 

0.38 

0.96 

-0.18 

50081 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50081 

A 

1 

37 

74 

0.62 

0.16 

0.91 

0.41 

50081 

B 

0 

6 

12 

-0.88 

0.54 

0.71 

-0.42 

50081 

C 

0 

6 

12 

0.20 

0.20 

1.23 

-0.05 

50081 

D 

0 

1 

2 

-1.23 

0.00 

0.26 

-0.21 

50082 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.00 

50082 

A 

1 

38 

75 

1.21 

0.21 

1.04 

0.33 

50082 

B 

0 

9 

18 

0.40 

0.54 

2.10 

-0.19 

50082 

C 

0 

2 

4 

-0.19 

0.39 

0.50 

-0.17 

50082 

D 

0 

2 

4 

-0.45 

0.00 

0.36 

-0.21 

50083 

* 

-1 

4700 

99 

0.90 

0.02 

0.00 

0.01 

50083 

A 

1 

18 

30 

1.28 

0.41 

3.81 

0.26 

50083 

B 

0 

36 

59 

0.52 

0.19 

1.13 

-0.21 

50083 

C 

0 

2 

3 

0.82 

0.54 

0.96 

0.01 

50083 

D 

0 

5 

8 

0.51 

0.35 

0.82 

-0.06 

50084 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50084 

A 

1 

21 

41 

0.74 

0.25 

1.21 

0.32 

50084 

B 

0 

12 

24 

0.51 

0.18 

1.33 

0.11 

50084 

C 

0 

5 

10 

-0.82 

0.70 

0.65 

-0.29 

50084 

D 

0 

13 

25 

-0.28 

0.38 

0.96 

-0.26 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50085 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.04 

50085 

A 

1 

44 

77 

0.66 

0.20 

1.10 

0.29 

50085 

B 

0 

1 

2 

-1.29 

0.00 

0.26 

-0.17 

50085 

C 

0 

5 

9 

-0.12 

0.74 

1.84 

-0.13 

50085 

D 

0 

7 

12 

-0.22 

0.32 

1.11 

-0.19 

50086 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50086 

A 

1 

47 

85 

0.76 

0.20 

0.91 

0.40 

50086 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50086 

C 

0 

4 

7 

-0.79 

0.28 

0.55 

-0.26 

50086 

D 

0 

4 

7 

-0.88 

0.26 

0.50 

-0.28 

50087 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50087 

A 

1 

32 

59 

0.75 

0.24 

1.43 

0.25 

50087 

B 

0 

4 

7 

-0.76 

0.16 

0.37 

-0.27 

50087 

C 

0 

14 

26 

0.39 

0.39 

3.91 

-0.04 

50087 

D 

0 

4 

7 

-0.13 

0.24 

0.73 

-0.13 

50088 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50088 

A 

1 

31 

62 

1.21 

0.17 

0.74 

0.59 

50088 

B 

0 

15 

30 

-0.40 

0.24 

0.56 

-0.59 

50088 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50088 

D 

0 

4 

8 

0.37 

0.50 

1.26 

-0.07 

50089 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.03 

50089 

A 

1 

52 

91 

0.72 

0.19 

0.97 

0.37 

50089 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50089 

C 

0 

5 

9 

-1.19 

0.51 

0.69 

-0.37 

50089 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50090 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50090 

A 

1 

46 

88 

0.50 

0.15 

0.74 

0.52 

50090 

B 

0 

4 

8 

-1.38 

0.60 

0.51 

-0.41 

50090 

C 

0 

1 

2 

-2.70 

0.00 

0.08 

-0.35 

50090 

D 

0 

1 

2 

-0.18 

0.00 

0.99 

-0.06 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50091 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

50091 

A 

1 

47 

84 

0.90 

0.18 

0.82 

0.55 

50091 

B 

0 

4 

7 

-1.84 

0.32 

0.18 

-0.48 

50091 

C 

0 

2 

4 

-1.04 

0.91 

0.50 

-0.22 

50091 

D 

0 

3 

5 

-0.46 

0.19 

0.64 

-0.17 

50092 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50092 

A 

1 

11 

22 

1.32 

0.51 

1.30 

0.37 

50092 

B 

0 

5 

10 

-0.06 

0.46 

0.86 

-0.13 

50092 

C 

0 

29 

58 

0.30 

0.19 

1.11 

-0.13 

50092 

D 

0 

5 

10 

-0.16 

0.44 

0.68 

-0.16 

50093 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.02 

50093 

A 

1 

13 

23 

1.74 

0.53 

1.78 

0.44 

50093 

B 

0 

5 

9 

-0.04 

0.77 

1.38 

-0.15 

50093 

C 

0 

33 

58 

0.42 

0.14 

0.93 

-0.17 

50093 

D 

0 

6 

11 

-0.14 

0.52 

0.61 

-0.19 

50094 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50094 

A 

1 

48 

91 

0.68 

0.19 

0.93 

0.28 

50094 

B 

0 

4 

8 

-0.87 

0.70 

1.03 

-0.30 

50094 

C 

0 

1 

2 

0.33 

0.00 

1.46 

-0.02 

50094 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50095 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.03 

50095 

A 

1 

48 

84 

0.60 

0.21 

1.13 

0.17 

50095 

B 

0 

5 

9 

1.03 

0.91 

11.07 

0.11 

50095 

C 

0 

1 

2 

-1.41 

0.00 

0.30 

-0.16 

50095 

D 

0 

3 

5 

-1.54 

0.24 

0.28 

-0.31 

50096 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

50096 

A 

1 

40 

80 

0.72 

0.20 

1.19 

0.22 

50096 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50096 

C 

0 

10 

20 

0.05 

0.27 

1.33 

-0.22 

50096 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50097 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.02 

50097 

A 

1 

50 

85 

0.90 

0.18 

0.99 

0.42 

50097 

B 

0 

5 

8 

-0.63 

0.57 

0.87 

-0.29 

50097 

C 

0 

3 

5 

-0.71 

0.62 

0.59 

-0.24 

50097 

D 

0 

1 

2 

-0.81 

0.00 

0.40 

-0.14 

50098 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.00 

50098 

A 

1 

49 

92 

1.02 

0.21 

1.15 

0.17 

50098 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50098 

C 

0 

3 

6 

0.27 

0.24 

1.16 

-0.11 

50098 

D 

0 

1 

2 

-0.56 

0.00 

0.48 

-0.14 

50099 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.01 

50099 

A 

1 

45 

87 

1.07 

0.21 

0.91 

0.43 

50099 

B 

0 

2 

4 

-1.44 

1.27 

0.40 

-0.30 

50099 

C 

0 

1 

2 

0.24 

0.00 

1.13 

-0.05 

50099 

D 

0 

4 

8 

-0.77 

0.57 

0.57 

-0.30 

50100 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50100 

A 

1 

7 

14 

1.54 

0.60 

1.81 

0.46 

50100 

B 

0 

3 

6 

-0.16 

1.21 

1.59 

-0.08 

50100 

C 

0 

33 

65 

0.03 

0.16 

0.80 

-0.20 

50100 

D 

0 

8 

16 

-0.12 

0.24 

0.56 

-0.12 

50101 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50101 

A 

1 

46 

96 

0.39 

0.19 

1.03 

0.16 

50101 

B 

0 

1 

2 

0.05 

0.00 

1.41 

-0.03 

50101 

C 

0 

1 

2 

-1.40 

0.00 

0.33 

-0.20 

50101 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50102 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50102 

A 

1 

46 

94 

0.56 

0.15 

1.05 

0.16 

50102 

B 

0 

2 

4 

-0.51 

0.08 

0.52 

-0.22 

50102 

C 

0 

1 

2 

0.78 

0.00 

1.90 

0.04 

50102 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50103 

* 

-1 

4699 

99 

0.90 

0.02 

0.00 

0.01 

50103 

A 

1 

54 

87 

0.95 

0.18 

1.06 

0.26 

50103 

B 

0 

2 

3 

0.46 

0.09 

1.22 

-0.05 

50103 

C 

0 

6 

10 

-0.24 

0.54 

1.28 

-0.27 

50103 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50104 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50104 

A 

1 

51 

96 

0.47 

0.14 

0.97 

0.27 

50104 

B 

0 

1 

2 

-0.79 

0.00 

0.45 

-0.17 

50104 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50104 

D 

0 

1 

2 

-1.13 

0.00 

0.32 

-0.22 

50105 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50105 

A 

1 

48 

98 

0.11 

0.12 

1.02 

-0.08 

50105 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50105 

C 

0 

1 

2 

0.59 

0.00 

2.07 

0.08 

50105 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50106 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50106 

A 

1 

43 

86 

0.28 

0.16 

1.19 

-0.02 

50106 

B 

0 

4 

8 

0.36 

0.24 

1.62 

0.02 

50106 

C 

0 

2 

4 

0.23 

0.31 

1.36 

-0.01 

50106 

D 

0 

1 

2 

0.41 

0.00 

1.55 

0.02 

50107 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.07 

50107 

A 

1 

43 

83 

0.23 

0.14 

0.80 

0.38 

50107 

B 

0 

3 

6 

0.22 

1.00 

3.11 

0.04 

50107 

C 

0 

3 

6 

-1.70 

0.19 

0.25 

-0.38 

50107 

D 

0 

3 

6 

-1.28 

1.33 

1.05 

-0.29 

50108 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

50108 

A 

1 

38 

79 

0.98 

0.23 

0.92 

0.42 

50108 

B 

0 

3 

6 

-0.48 

0.37 

0.59 

-0.21 

50108 

C 

0 

2 

4 

-1.21 

0.03 

0.25 

-0.28 

50108 

D 

0 

5 

10 

-0.20 

0.33 

0.83 

-0.21 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50109 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50109 

A 

1 

33 

63 

1.02 

0.21 

0.88 

0.55 

50109 

B 

0 

8 

15 

-0.50 

0.30 

0.69 

-0.29 

50109 

C 

0 

7 

13 

-0.51 

0.53 

1.25 

-0.27 

50109 

D 

0 

4 

8 

-0.73 

0.51 

0.58 

-0.25 

50110 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50110 

A 

1 

22 

43 

0.56 

0.25 

1.41 

0.23 

50110 

B 

0 

19 

37 

0.27 

0.21 

1.49 

-0.01 

50110 

C 

0 

4 

8 

0.13 

0.29 

0.95 

-0.04 

50110 

D 

0 

6 

12 

-0.59 

0.39 

0.55 

-0.31 

50111 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50111 

A 

1 

28 

54 

1.02 

0.28 

1.40 

0.41 

50111 

B 

0 

10 

19 

0.29 

0.29 

1.29 

-0.03 

50111 

C 

0 

7 

13 

-0.19 

0.37 

0.80 

-0.14 

50111 

D 

0 

7 

13 

-1.29 

0.88 

0.50 

-0.41 

50112 

* 

-1 

4493 

94 

0.90 

0.02 

0.00 

0.00 

50112 

A 

1 

214 

80 

1.06 

0.07 

0.98 

0.32 

50112 

B 

0 

31 

12 

0.26 

0.14 

0.91 

-0.23 

50112 

C 

0 

19 

7 

0.40 

0.22 

1.24 

-0.14 

50112 

D 

0 

4 

1 

-0.23 

0.60 

0.75 

-0.14 

50113 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.06 

50113 

A 

1 

36 

71 

0.45 

0.18 

0.96 

0.42 

50113 

B 

0 

4 

8 

-1.01 

0.38 

0.49 

-0.29 

50113 

C 

0 

6 

12 

-0.21 

0.43 

1.33 

-0.11 

50113 

D 

0 

5 

10 

-0.74 

0.41 

0.69 

-0.25 

50114 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.02 

50114 

A 

1 

43 

74 

0.95 

0.16 

0.95 

0.46 

50114 

B 

0 

9 

16 

0.10 

0.29 

1.02 

-0.21 

50114 

C 

0 

2 

3 

0.09 

0.46 

0.82 

-0.09 

50114 

D 

0 

4 

7 

-1.10 

0.18 

0.24 

-0.43 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50115 

* 

-1 

4452 

94 

0.87 

0.02 

0.00 

-0.09 

50115 

A 

1 

293 

95 

1.44 

0.07 

0.96 

0.28 

50115 

B 

0 

8 

3 

0.14 

0.39 

0.74 

-0.17 

50115 

C 

0 

8 

3 

-0.12 

0.21 

0.41 

-0.21 

50115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50116 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.06 

50116 

A 

1 

46 

88 

0.34 

0.14 

0.90 

0.41 

50116 

B 

0 

4 

8 

-1.12 

0.27 

0.41 

-0.38 

50116 

C 

0 

1 

2 

-0.89 

0.00 

0.46 

-0.15 

50116 

D 

0 

1 

2 

-0.23 

0.00 

0.90 

-0.06 

50117 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.01 

50117 

A 

1 

55 

95 

0.86 

0.14 

0.99 

0.25 

50117 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50117 

C 

0 

2 

3 

-0.21 

0.22 

0.57 

-0.19 

50117 

D 

0 

1 

2 

-0.44 

0.00 

0.44 

-0.16 

50118 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50118 

A 

1 

45 

92 

0.60 

0.18 

0.86 

0.40 

50118 

B 

0 

2 

4 

-1.28 

0.54 

0.34 

-0.29 

50118 

C 

0 

1 

2 

-1.85 

0.00 

0.17 

-0.27 

50118 

D 

0 

1 

2 

-0.46 

0.00 

0.67 

-0.11 

50119 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.03 

50119 

A 

1 

49 

83 

0.86 

0.15 

0.84 

0.53 

50119 

B 

0 

3 

5 

-1.21 

0.72 

0.38 

-0.35 

50119 

C 

0 

3 

5 

-0.48 

0.37 

0.58 

-0.21 

50119 

D 

0 

4 

7 

-0.77 

0.35 

0.46 

-0.31 

50120 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50120 

A 

1 

47 

94 

0.45 

0.16 

0.95 

0.32 

50120 

B 

0 

2 

4 

-0.62 

0.07 

0.62 

-0.18 

50120 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50120 

D 

0 

1 

2 

-1.97 

0.00 

0.16 

-0.29 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50121 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.05 

50121 

A 

1 

43 

80 

0.46 

0.13 

0.83 

0.48 

50121 

B 

0 

5 

9 

-0.52 

0.52 

1.07 

-0.25 

50121 

C 

0 

3 

6 

-0.86 

0.32 

0.46 

-0.28 

50121 

D 

0 

3 

6 

-0.72 

0.45 

0.60 

-0.25 

50122 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50122 

A 

1 

45 

94 

0.58 

0.16 

1.14 

0.04 

50122 

B 

0 

2 

4 

0.67 

0.03 

1.75 

0.02 

50122 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50122 

D 

0 

1 

2 

-0.12 

0.00 

0.80 

-0.09 

50123 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

0.02 

50123 

A 

1 

49 

78 

0.95 

0.15 

1.00 

0.38 

50123 

B 

0 

3 

5 

-0.99 

0.52 

0.32 

-0.34 

50123 

C 

0 

8 

13 

0.33 

0.30 

1.37 

-0.13 

50123 

D 

0 

3 

5 

-0.22 

0.68 

0.86 

-0.19 

50124 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50124 

A 

1 

43 

88 

0.47 

0.23 

0.94 

0.39 

50124 

B 

0 

2 

4 

-0.83 

0.67 

0.84 

-0.14 

50124 

C 

0 

1 

2 

-0.46 

0.00 

0.99 

-0.07 

50124 

D 

0 

3 

6 

-2.06 

0.38 

0.23 

-0.38 

50125 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50125 

A 

1 

42 

84 

0.66 

0.18 

0.84 

0.46 

50125 

B 

0 

2 

4 

-0.81 

0.20 

0.48 

-0.19 

50125 

C 

0 

1 

2 

0.55 

0.00 

1.80 

0.02 

50125 

D 

0 

5 

10 

-1.38 

0.60 

0.48 

-0.45 

50126 

* 

-1 

4473 

94 

0.86 

0.02 

0.00 

-0.13 

50126 

A 

1 

262 

91 

1.69 

0.06 

1.06 

0.29 

50126 

B 

0 

13 

5 

0.95 

0.26 

1.24 

-0.13 

50126 

C 

0 

13 

5 

0.28 

0.33 

0.75 

-0.26 

50126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50127 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.08 

50127 

A 

1 

42 

82 

0.18 

0.17 

0.83 

0.48 

50127 

B 

0 

2 

4 

-0.72 

0.69 

0.95 

-0.11 

50127 

C 

0 

3 

6 

-1.50 

0.23 

0.36 

-0.31 

50127 

D 

0 

4 

8 

-1.38 

0.51 

0.59 

-0.33 

50128 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50128 

A 

1 

33 

66 

0.61 

0.21 

0.82 

0.46 

50128 

B 

0 

11 

22 

-0.53 

0.31 

0.99 

-0.31 

50128 

C 

0 

4 

8 

-1.21 

0.24 

0.34 

-0.33 

50128 

D 

0 

2 

4 

0.27 

0.66 

1.69 

0.01 

50129 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50129 

A 

1 

45 

88 

0.42 

0.17 

1.07 

0.05 

50129 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50129 

C 

0 

4 

8 

-0.20 

0.25 

0.86 

-0.16 

50129 

D 

0 

2 

4 

1.12 

0.19 

2.99 

0.13 

50130 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50130 

A 

1 

32 

65 

0.57 

0.16 

1.01 

0.33 

50130 

B 

0 

11 

22 

0.34 

0.18 

1.31 

0.00 

50130 

C 

0 

4 

8 

-0.60 

0.74 

0.85 

-0.28 

50130 

D 

0 

2 

4 

-1.69 

0.13 

0.15 

-0.42 

50131 

* 

-1 

4492 

94 

0.86 

0.02 

0.00 

-0.12 

50131 

A 

1 

210 

78 

1.83 

0.07 

1.00 

0.49 

50131 

B 

0 

15 

6 

0.17 

0.26 

0.48 

-0.31 

50131 

C 

0 

35 

13 

0.92 

0.13 

0.97 

-0.22 

50131 

D 

0 

9 

3 

-0.37 

0.26 

0.25 

-0.33 

50132 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50132 

A 

1 

20 

40 

0.83 

0.39 

1.59 

0.33 

50132 

B 

0 

17 

34 

0.17 

0.19 

1.39 

-0.05 

50132 

C 

0 

6 

12 

0.17 

0.51 

1.69 

-0.03 

50132 

D 

0 

7 

14 

-0.98 

0.25 

0.36 

-0.36 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50133 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

50133 

A 

1 

25 

50 

1.37 

0.25 

0.85 

0.56 

50133 

B 

0 

13 

26 

-0.21 

0.36 

1.07 

-0.35 

50133 

C 

0 

4 

8 

-0.73 

0.13 

0.29 

-0.29 

50133 

D 

0 

8 

16 

0.19 

0.23 

0.86 

-0.13 

50134 

* 

-1 

4702 

99 

0.90 

0.02 

0.00 

0.01 

50134 

A 

1 

42 

71 

0.92 

0.22 

1.43 

0.20 

50134 

B 

0 

16 

27 

0.28 

0.22 

1.24 

-0.22 

50134 

C 

0 

1 

2 

1.37 

0.00 

2.54 

0.06 

50134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50135 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.05 

50135 

A 

1 

30 

55 

0.48 

0.21 

1.21 

0.23 

50135 

B 

0 

16 

29 

0.10 

0.20 

1.30 

-0.08 

50135 

C 

0 

6 

11 

0.15 

0.30 

1.26 

-0.03 

50135 

D 

0 

3 

5 

-1.19 

1.14 

0.91 

-0.31 

50136 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.07 

50136 

A 

1 

10 

20 

0.91 

0.52 

1.20 

0.39 

50136 

B 

0 

24 

48 

-0.01 

0.16 

0.94 

-0.04 

50136 

C 

0 

14 

28 

-0.35 

0.27 

0.83 

-0.22 

50136 

D 

0 

2 

4 

-1.03 

0.58 

0.31 

-0.19 

50137 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50137 

A 

1 

29 

58 

0.75 

0.26 

1.02 

0.42 

50137 

B 

0 

5 

10 

-0.77 

0.34 

0.52 

-0.25 

50137 

C 

0 

13 

26 

-0.44 

0.32 

0.90 

-0.30 

50137 

D 

0 

3 

6 

0.23 

0.19 

1.21 

0.00 

50138 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.02 

50138 

A 

1 

48 

84 

0.88 

0.19 

1.09 

0.32 

50138 

B 

0 

2 

4 

-0.71 

0.49 

0.47 

-0.20 

50138 

C 

0 

4 

7 

0.19 

0.60 

1.92 

-0.10 

50138 

D 

0 

3 

5 

-0.64 

0.66 

0.62 

-0.24 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50139 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50139 

A 

1 

27 

54 

1.10 

0.23 

0.81 

0.54 

50139 

B 

0 

14 

28 

0.18 

0.22 

1.25 

-0.14 

50139 

C 

0 

2 

4 

-0.42 

0.12 

0.48 

-0.14 

50139 

D 

0 

7 

14 

-1.13 

0.26 

0.30 

-0.51 

50140 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50140 

A 

1 

31 

58 

0.88 

0.19 

0.97 

0.46 

50140 

B 

0 

12 

23 

0.21 

0.31 

1.33 

-0.12 

50140 

C 

0 

1 

2 

-0.05 

0.00 

0.67 

-0.06 

50140 

D 

0 

9 

17 

-0.63 

0.15 

0.41 

-0.44 

50141 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50141 

A 

1 

4 

8 

0.19 

0.31 

1.91 

-0.06 

50141 

B 

0 

13 

27 

1.05 

0.20 

1.80 

0.46 

50141 

C 

0 

13 

27 

0.10 

0.30 

0.93 

-0.17 

50141 

D 

0 

18 

38 

0.08 

0.19 

0.71 

-0.23 

50142 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.06 

50142 

A 

1 

21 

42 

0.40 

0.23 

1.38 

0.28 

50142 

B 

0 

13 

26 

-0.15 

0.19 

0.91 

-0.14 

50142 

C 

0 

1 

2 

0.19 

0.00 

1.07 

0.02 

50142 

D 

0 

15 

30 

-0.19 

0.27 

1.51 

-0.18 

50143 

* 

-1 

4697 

99 

0.91 

0.02 

0.00 

0.02 

50143 

A 

1 

32 

50 

1.21 

0.20 

0.97 

0.45 

50143 

B 

0 

17 

27 

-0.06 

0.31 

0.89 

-0.32 

50143 

C 

0 

5 

8 

-0.10 

0.74 

1.79 

-0.16 

50143 

D 

0 

10 

16 

0.34 

0.31 

1.05 

-0.10 

50144 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.00 

50144 

A 

1 

12 

25 

1.50 

0.38 

0.99 

0.34 

50144 

B 

0 

9 

19 

0.66 

0.24 

0.93 

-0.08 

50144 

C 

0 

15 

31 

0.58 

0.25 

1.02 

-0.16 

50144 

D 

0 

12 

25 

0.65 

0.35 

1.44 

-0.10 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50145 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50145 

A 

1 

35 

69 

0.61 

0.20 

0.95 

0.50 

50145 

B 

0 

12 

24 

-0.60 

0.23 

0.79 

-0.37 

50145 

C 

0 

1 

2 

-1.86 

0.00 

0.16 

-0.24 

50145 

D 

0 

3 

6 

-0.68 

0.19 

0.55 

-0.18 

50146 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.02 

50146 

A 

1 

49 

84 

0.73 

0.15 

0.96 

0.19 

50146 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50146 

C 

0 

6 

10 

0.54 

0.73 

4.48 

-0.03 

50146 

D 

0 

3 

5 

-0.69 

0.70 

0.65 

-0.27 

50147 

* 

-1 

4715 

99 

0.91 

0.02 

0.00 

0.04 

50147 

A 

1 

19 

41 

1.05 

0.23 

0.88 

0.54 

50147 

B 

0 

16 

35 

0.11 

0.22 

0.95 

-0.16 

50147 

C 

0 

10 

22 

-0.41 

0.24 

0.56 

-0.37 

50147 

D 

0 

1 

2 

-1.37 

0.00 

0.16 

-0.24 

50148 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.02 

50148 

A 

1 

21 

38 

1.59 

0.26 

1.10 

0.46 

50148 

B 

0 

21 

38 

0.43 

0.25 

1.18 

-0.11 

50148 

C 

0 

13 

23 

0.07 

0.22 

0.57 

-0.21 

50148 

D 

0 

1 

2 

-6.39 

0.00 

0.00 

-0.61 

50149 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50149 

A 

1 

40 

82 

0.50 

0.17 

0.85 

0.48 

50149 

B 

0 

3 

6 

-0.87 

0.53 

0.59 

-0.25 

50149 

C 

0 

4 

8 

-0.52 

0.44 

0.91 

-0.20 

50149 

D 

0 

2 

4 

-1.82 

0.05 

0.18 

-0.37 

50150 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50150 

A 

1 

18 

35 

0.99 

0.35 

2.26 

0.23 

50150 

B 

0 

23 

44 

0.54 

0.24 

1.48 

-0.05 

50150 

C 

0 

9 

17 

0.15 

0.22 

0.67 

-0.17 

50150 

D 

0 

2 

4 

-0.11 

0.21 

0.44 

-0.12 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50151 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.00 

50151 

A 

1 

47 

92 

1.09 

0.20 

0.77 

0.47 

50151 

B 

0 

2 

4 

-0.95 

0.41 

0.41 

-0.24 

50151 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50151 

D 

0 

2 

4 

-2.20 

1.74 

0.32 

-0.40 

50152 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.02 

50152 

A 

1 

40 

75 

1.11 

0.19 

0.88 

0.55 

50152 

B 

0 

4 

8 

-0.58 

0.65 

0.72 

-0.28 

50152 

C 

0 

6 

11 

-0.55 

0.30 

0.52 

-0.34 

50152 

D 

0 

3 

6 

-0.60 

0.65 

0.56 

-0.24 

50153 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.00 

50153 

A 

1 

42 

88 

1.08 

0.21 

0.84 

0.46 

50153 

B 

0 

1 

2 

-1.37 

0.00 

0.21 

-0.23 

50153 

C 

0 

3 

6 

-0.77 

0.40 

0.45 

-0.30 

50153 

D 

0 

2 

4 

-0.69 

0.10 

0.41 

-0.23 

50154 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50154 

A 

1 

51 

94 

0.69 

0.14 

0.82 

0.40 

50154 

B 

0 

2 

4 

-1.94 

0.68 

0.16 

-0.44 

50154 

C 

0 

1 

2 

0.03 

0.00 

0.95 

-0.07 

50154 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50155 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50155 

A 

1 

42 

81 

0.88 

0.18 

0.81 

0.51 

50155 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50155 

C 

0 

10 

19 

-0.85 

0.41 

0.59 

-0.51 

50155 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50156 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50156 

A 

1 

47 

89 

1.03 

0.18 

0.80 

0.50 

50156 

B 

0 

2 

4 

-1.04 

1.32 

0.63 

-0.26 

50156 

C 

0 

1 

2 

-0.51 

0.00 

0.53 

-0.13 

50156 

D 

0 

3 

6 

-1.51 

0.48 

0.24 

-0.40 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50157 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.02 

50157 

A 

1 

39 

76 

0.91 

0.18 

1.00 

0.48 

50157 

B 

0 

1 

2 

-0.44 

0.00 

0.48 

-0.13 

50157 

C 

0 

6 

12 

-0.31 

0.28 

0.66 

-0.29 

50157 

D 

0 

5 

10 

-0.50 

0.41 

0.62 

-0.31 

50158 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50158 

A 

1 

43 

88 

0.92 

0.20 

1.02 

0.24 

50158 

B 

0 

2 

4 

0.89 

0.66 

2.24 

0.01 

50158 

C 

0 

4 

8 

-0.50 

0.38 

0.56 

-0.30 

50158 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50159 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.02 

50159 

A 

1 

46 

78 

0.92 

0.17 

0.96 

0.41 

50159 

B 

0 

6 

10 

0.20 

0.37 

1.15 

-0.13 

50159 

C 

0 

3 

5 

-0.40 

0.30 

0.51 

-0.21 

50159 

D 

0 

4 

7 

-0.73 

0.44 

0.43 

-0.32 

50160 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.02 

50160 

A 

1 

37 

70 

1.01 

0.23 

0.95 

0.43 

50160 

B 

0 

4 

8 

0.21 

0.72 

2.12 

-0.08 

50160 

C 

0 

10 

19 

-0.72 

0.27 

0.54 

-0.44 

50160 

D 

0 

2 

4 

0.43 

0.24 

1.33 

-0.02 

50161 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50161 

A 

1 

40 

75 

0.90 

0.18 

0.74 

0.54 

50161 

B 

0 

1 

2 

1.84 

0.00 

5.78 

0.14 

50161 

C 

0 

5 

9 

-0.50 

0.42 

0.79 

-0.22 

50161 

D 

0 

7 

13 

-1.54 

0.50 

0.34 

-0.55 

50162 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.00 

50162 

A 

1 

38 

75 

1.06 

0.21 

1.05 

0.27 

50162 

B 

0 

3 

6 

1.64 

0.74 

5.06 

0.14 

50162 

C 

0 

7 

14 

-0.03 

0.54 

1.69 

-0.26 

50162 

D 

0 

3 

6 

-0.59 

0.33 

0.40 

-0.27 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50163 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.01 

50163 

A 

1 

41 

79 

0.91 

0.22 

1.24 

0.21 

50163 

B 

0 

1 

2 

-1.32 

0.00 

0.21 

-0.20 

50163 

C 

0 

6 

12 

0.83 

0.68 

4.38 

0.02 

50163 

D 

0 

4 

8 

-0.41 

0.27 

0.57 

-0.24 

50164 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.00 

50164 

A 

1 

39 

76 

1.17 

0.22 

0.96 

0.39 

50164 

B 

0 

2 

4 

-0.73 

0.67 

0.39 

-0.24 

50164 

C 

0 

4 

8 

0.68 

0.29 

1.44 

-0.04 

50164 

D 

0 

6 

12 

-0.34 

0.20 

0.51 

-0.33 

50165 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50165 

A 

1 

38 

72 

0.94 

0.25 

1.54 

0.43 

50165 

B 

0 

4 

8 

-0.66 

0.29 

0.55 

-0.21 

50165 

C 

0 

5 

9 

-0.61 

0.37 

0.66 

-0.23 

50165 

D 

0 

6 

11 

-0.46 

0.67 

2.25 

-0.22 

50166 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.02 

50166 

A 

1 

42 

79 

0.88 

0.19 

1.04 

0.30 

50166 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50166 

C 

0 

7 

13 

0.12 

0.31 

1.04 

-0.19 

50166 

D 

0 

4 

8 

-0.16 

0.32 

0.70 

-0.21 

50167 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.01 

50167 

A 

1 

42 

82 

1.09 

0.20 

0.84 

0.49 

50167 

B 

0 

1 

2 

-2.79 

0.00 

0.05 

-0.34 

50167 

C 

0 

2 

4 

-0.83 

0.55 

0.44 

-0.22 

50167 

D 

0 

6 

12 

-0.48 

0.47 

0.90 

-0.31 

50168 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50168 

A 

1 

40 

75 

0.82 

0.18 

0.82 

0.53 

50168 

B 

0 

1 

2 

-1.86 

0.00 

0.15 

-0.23 

50168 

C 

0 

6 

11 

0.02 

0.32 

1.22 

-0.10 

50168 

D 

0 

6 

11 

-1.65 

0.56 

0.35 

-0.53 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50169 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.02 

50169 

A 

1 

47 

87 

0.79 

0.17 

0.86 

0.36 

50169 

B 

0 

4 

7 

-0.84 

0.75 

0.74 

-0.33 

50169 

C 

0 

3 

6 

-0.12 

0.49 

0.95 

-0.14 

50169 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50170 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50170 

A 

1 

41 

80 

0.62 

0.20 

0.98 

0.36 

50170 

B 

0 

5 

10 

-0.71 

0.60 

0.86 

-0.28 

50170 

C 

0 

1 

2 

-1.31 

0.00 

0.28 

-0.18 

50170 

D 

0 

4 

8 

-0.22 

0.38 

1.00 

-0.14 

50171 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50171 

A 

1 

35 

70 

0.84 

0.24 

0.91 

0.46 

50171 

B 

0 

7 

14 

-0.49 

0.25 

0.73 

-0.25 

50171 

C 

0 

3 

6 

-1.09 

0.24 

0.36 

-0.26 

50171 

D 

0 

5 

10 

-0.52 

0.67 

1.60 

-0.21 

50172 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50172 

A 

1 

20 

42 

1.22 

0.31 

1.67 

0.41 

50172 

B 

0 

9 

19 

0.48 

0.39 

1.80 

-0.03 

50172 

C 

0 

14 

29 

-0.19 

0.34 

0.67 

-0.36 

50172 

D 

0 

5 

10 

0.24 

0.14 

0.71 

-0.08 

50173 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50173 

A 

1 

23 

44 

1.11 

0.22 

0.90 

0.48 

50173 

B 

0 

9 

17 

0.38 

0.27 

1.18 

-0.04 

50173 

C 

0 

12 

23 

0.01 

0.36 

1.29 

-0.23 

50173 

D 

0 

8 

15 

-0.46 

0.31 

0.51 

-0.35 

50174 

* 

-1 

4492 

94 

0.87 

0.02 

0.00 

-0.11 

50174 

A 

1 

175 

65 

1.88 

0.08 

0.94 

0.45 

50174 

B 

0 

44 

16 

1.15 

0.13 

1.30 

-0.12 

50174 

C 

0 

38 

14 

0.62 

0.17 

0.86 

-0.29 

50174 

D 

0 

12 

4 

-0.41 

0.23 

0.25 

-0.34 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50175 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50175 

A 

1 

21 

40 

1.03 

0.27 

1.10 

0.49 

50175 

B 

0 

13 

25 

-0.09 

0.22 

0.83 

-0.22 

50175 

C 

0 

11 

21 

0.30 

0.22 

1.11 

-0.02 

50175 

D 

0 

7 

13 

-0.81 

0.36 

0.40 

-0.39 

50176 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.05 

50176 

A 

1 

30 

56 

0.62 

0.16 

1.02 

0.43 

50176 

B 

0 

10 

19 

-0.64 

0.33 

0.65 

-0.39 

50176 

C 

0 

6 

11 

0.07 

0.52 

1.56 

-0.05 

50176 

D 

0 

8 

15 

-0.11 

0.28 

0.94 

-0.13 

50177 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.00 

50177 

A 

1 

34 

68 

1.42 

0.20 

0.81 

0.53 

50177 

B 

0 

1 

2 

0.51 

0.00 

0.87 

-0.05 

50177 

C 

0 

11 

22 

0.19 

0.34 

1.07 

-0.30 

50177 

D 

0 

4 

8 

-1.05 

0.44 

0.24 

-0.44 

50178 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50178 

A 

1 

24 

50 

1.54 

0.27 

0.66 

0.61 

50178 

B 

0 

8 

17 

0.09 

0.36 

1.06 

-0.12 

50178 

C 

0 

11 

23 

-0.58 

0.33 

0.56 

-0.37 

50178 

D 

0 

5 

10 

-1.17 

0.95 

0.95 

-0.35 

50179 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.02 

50179 

A 

1 

34 

63 

1.28 

0.19 

0.76 

0.61 

50179 

B 

0 

8 

15 

0.23 

0.29 

1.03 

-0.15 

50179 

C 

0 

3 

6 

-0.75 

0.15 

0.30 

-0.27 

50179 

D 

0 

9 

17 

-0.70 

0.31 

0.42 

-0.48 

50180 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.00 

50180 

A 

1 

19 

36 

1.89 

0.25 

0.63 

0.65 

50180 

B 

0 

14 

26 

0.21 

0.21 

0.64 

-0.31 

50180 

C 

0 

13 

25 

0.34 

0.22 

0.75 

-0.24 

50180 

D 

0 

7 

13 

0.22 

0.41 

0.92 

-0.20 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50181 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.03 

50181 

A 

1 

39 

68 

0.93 

0.20 

1.04 

0.41 

50181 

B 

0 

8 

14 

-0.12 

0.41 

0.97 

-0.23 

50181 

C 

0 

1 

2 

-1.24 

0.00 

0.21 

-0.20 

50181 

D 

0 

9 

16 

-0.06 

0.22 

0.81 

-0.23 

50182 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.02 

50182 

A 

1 

30 

53 

1.69 

0.27 

1.07 

0.61 

50182 

B 

0 

4 

7 

-1.00 

0.12 

0.24 

-0.28 

50182 

C 

0 

8 

14 

-0.41 

0.46 

0.67 

-0.27 

50182 

D 

0 

15 

26 

-0.19 

0.32 

0.84 

-0.32 

50183 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.04 

50183 

A 

1 

33 

59 

1.07 

0.18 

0.68 

0.61 

50183 

B 

0 

7 

13 

-0.34 

0.37 

0.76 

-0.22 

50183 

C 

0 

8 

14 

-0.37 

0.22 

0.61 

-0.25 

50183 

D 

0 

8 

14 

-0.83 

0.53 

0.57 

-0.39 

50184 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

50184 

A 

1 

19 

36 

1.39 

0.28 

0.74 

0.61 

50184 

B 

0 

9 

17 

0.27 

0.15 

0.98 

0.00 

50184 

C 

0 

14 

26 

-0.27 

0.21 

0.66 

-0.23 

50184 

D 

0 

11 

21 

-1.02 

0.43 

0.41 

-0.47 

50185 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50185 

A 

1 

39 

74 

0.94 

0.20 

0.93 

0.58 

50185 

B 

0 

7 

13 

-0.93 

0.39 

0.58 

-0.37 

50185 

C 

0 

4 

8 

-1.18 

0.56 

0.41 

-0.32 

50185 

D 

0 

3 

6 

-0.69 

0.27 

0.51 

-0.19 

50186 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.00 

50186 

A 

1 

28 

54 

1.71 

0.29 

1.15 

0.53 

50186 

B 

0 

9 

17 

0.23 

0.54 

2.57 

-0.17 

50186 

C 

0 

7 

13 

0.00 

0.35 

0.73 

-0.20 

50186 

D 

0 

8 

15 

-0.65 

0.54 

0.49 

-0.37 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50187 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.03 

50187 

A 

1 

39 

68 

0.81 

0.16 

1.00 

0.39 

50187 

B 

0 

7 

12 

-0.04 

0.27 

0.83 

-0.22 

50187 

C 

0 

6 

11 

0.44 

0.38 

1.38 

-0.04 

50187 

D 

0 

5 

9 

-0.56 

0.25 

0.43 

-0.34 

50188 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50188 

A 

1 

23 

47 

0.68 

0.21 

1.10 

0.22 

50188 

B 

0 

6 

12 

0.88 

0.30 

2.11 

0.15 

50188 

C 

0 

10 

20 

0.40 

0.39 

2.09 

0.00 

50188 

D 

0 

10 

20 

-0.57 

0.49 

1.14 

-0.40 

50189 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50189 

A 

1 

31 

61 

0.91 

0.15 

0.84 

0.53 

50189 

B 

0 

1 

2 

-0.17 

0.00 

0.56 

-0.09 

50189 

C 

0 

7 

14 

-0.68 

0.32 

0.44 

-0.47 

50189 

D 

0 

12 

24 

0.15 

0.24 

0.96 

-0.19 

50190 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.07 

50190 

A 

1 

25 

51 

0.72 

0.21 

0.70 

0.56 

50190 

B 

0 

2 

4 

-1.47 

0.44 

0.27 

-0.22 

50190 

C 

0 

9 

18 

-0.34 

0.17 

0.85 

-0.11 

50190 

D 

0 

13 

27 

-1.00 

0.43 

1.02 

-0.44 

50191 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50191 

A 

1 

39 

75 

0.51 

0.19 

1.03 

0.36 

50191 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50191 

C 

0 

9 

17 

-0.32 

0.27 

0.98 

-0.24 

50191 

D 

0 

4 

8 

-0.69 

0.24 

0.56 

-0.25 

50192 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.01 

50192 

A 

1 

48 

83 

0.99 

0.19 

0.96 

0.36 

50192 

B 

0 

2 

3 

-0.48 

0.82 

0.63 

-0.18 

50192 

C 

0 

5 

9 

0.35 

0.40 

1.33 

-0.10 

50192 

D 

0 

3 

5 

-1.18 

0.46 

0.29 

-0.35 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50193 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.01 

50193 

A 

1 

32 

67 

0.89 

0.18 

1.09 

0.25 

50193 

B 

0 

10 

21 

0.34 

0.22 

0.97 

-0.18 

50193 

C 

0 

4 

8 

0.41 

1.11 

4.83 

-0.08 

50193 

D 

0 

2 

4 

0.13 

0.28 

0.69 

-0.11 

50194 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.06 

50194 

A 

1 

42 

79 

0.44 

0.17 

0.99 

0.46 

50194 

B 

0 

3 

6 

-0.82 

0.18 

0.53 

-0.22 

50194 

C 

0 

3 

6 

-0.53 

0.38 

0.80 

-0.15 

50194 

D 

0 

5 

9 

-1.00 

0.43 

0.60 

-0.34 

50195 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50195 

A 

1 

33 

63 

0.69 

0.22 

1.29 

0.46 

50195 

B 

0 

9 

17 

-0.08 

0.26 

1.05 

-0.12 

50195 

C 

0 

5 

10 

-0.50 

0.48 

0.84 

-0.19 

50195 

D 

0 

5 

10 

-1.30 

0.36 

0.30 

-0.40 

50196 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.07 

50196 

A 

1 

43 

81 

0.33 

0.18 

0.92 

0.44 

50196 

B 

0 

5 

9 

-0.20 

0.25 

1.31 

-0.07 

50196 

C 

0 

2 

4 

-1.83 

0.33 

0.25 

-0.29 

50196 

D 

0 

3 

6 

-2.11 

0.37 

0.20 

-0.41 

50197 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50197 

A 

1 

35 

71 

0.81 

0.20 

1.00 

0.45 

50197 

B 

0 

2 

4 

-1.41 

0.31 

0.21 

-0.32 

50197 

C 

0 

10 

20 

-0.27 

0.25 

0.80 

-0.31 

50197 

D 

0 

2 

4 

-0.11 

0.21 

0.77 

-0.10 

50198 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50198 

A 

1 

49 

92 

0.67 

0.18 

1.06 

0.27 

50198 

B 

0 

4 

8 

-0.63 

0.21 

0.57 

-0.27 

50198 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50198 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50199 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.02 

50199 

A 

1 

35 

65 

1.17 

0.25 

0.81 

0.50 

50199 

B 

0 

16 

30 

-0.36 

0.27 

0.87 

-0.42 

50199 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50199 

D 

0 

3 

6 

-0.66 

0.45 

0.50 

-0.21 

50200 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50200 

A 

1 

43 

86 

0.78 

0.14 

0.76 

0.60 

50200 

B 

0 

4 

8 

-1.03 

0.17 

0.31 

-0.43 

50200 

C 

0 

1 

2 

-1.87 

0.00 

0.13 

-0.32 

50200 

D 

0 

2 

4 

-0.63 

0.74 

0.58 

-0.22 

50201 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.04 

50201 

A 

1 

14 

24 

0.96 

0.27 

1.22 

0.30 

50201 

B 

0 

10 

17 

0.35 

0.39 

1.52 

-0.06 

50201 

C 

0 

17 

29 

0.29 

0.13 

0.81 

-0.13 

50201 

D 

0 

17 

29 

0.33 

0.20 

0.99 

-0.10 

50202 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

50202 

A 

1 

11 

22 

1.79 

0.42 

1.02 

0.47 

50202 

B 

0 

8 

16 

0.80 

0.45 

1.50 

0.07 

50202 

C 

0 

11 

22 

0.24 

0.43 

0.96 

-0.14 

50202 

D 

0 

20 

40 

0.05 

0.22 

0.63 

-0.33 

50203 

* 

-1 

4699 

99 

0.91 

0.02 

0.00 

0.03 

50203 

A 

1 

30 

48 

1.02 

0.24 

1.21 

0.37 

50203 

B 

0 

14 

23 

-0.06 

0.24 

0.85 

-0.29 

50203 

C 

0 

5 

8 

1.09 

0.54 

3.16 

0.13 

50203 

D 

0 

13 

21 

0.03 

0.18 

0.71 

-0.24 

50204 

* 

-1 

4502 

95 

0.88 

0.02 

0.00 

-0.07 

50204 

A 

1 

160 

62 

1.77 

0.08 

0.82 

0.55 

50204 

B 

0 

22 

8 

0.57 

0.20 

0.76 

-0.19 

50204 

C 

0 

57 

22 

0.58 

0.08 

0.68 

-0.33 

50204 

D 

0 

20 

8 

0.17 

0.26 

0.67 

-0.28 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50205 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

50205 

A 

1 

12 

21 

1.70 

0.41 

0.94 

0.50 

50205 

B 

0 

6 

11 

0.93 

0.40 

1.92 

0.12 

50205 

C 

0 

21 

38 

0.08 

0.22 

0.81 

-0.25 

50205 

D 

0 

17 

30 

-0.01 

0.24 

0.77 

-0.26 

50206 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.01 

50206 

A 

1 

22 

41 

1.84 

0.24 

0.70 

0.62 

50206 

B 

0 

10 

19 

-0.15 

0.26 

0.45 

-0.35 

50206 

C 

0 

9 

17 

0.37 

0.45 

1.23 

-0.15 

50206 

D 

0 

13 

24 

0.19 

0.27 

0.70 

-0.27 

50207 

* 

-1 

4474 

94 

0.86 

0.02 

0.00 

-0.12 

50207 

A 

1 

170 

59 

2.10 

0.08 

0.82 

0.56 

50207 

B 

0 

33 

11 

0.61 

0.18 

0.61 

-0.29 

50207 

C 

0 

69 

24 

0.93 

0.10 

0.86 

-0.29 

50207 

D 

0 

15 

5 

0.27 

0.26 

0.46 

-0.25 

50208 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

50208 

A 

1 

27 

48 

0.97 

0.18 

0.94 

0.46 

50208 

B 

0 

13 

23 

-0.11 

0.29 

0.79 

-0.32 

50208 

C 

0 

6 

11 

0.47 

0.30 

1.21 

-0.01 

50208 

D 

0 

10 

18 

-0.01 

0.22 

0.73 

-0.23 

50209 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.02 

50209 

A 

1 

20 

36 

1.44 

0.41 

2.97 

0.38 

50209 

B 

0 

16 

29 

0.48 

0.29 

1.30 

-0.10 

50209 

C 

0 

6 

11 

0.69 

0.32 

1.10 

0.00 

50209 

D 

0 

14 

25 

-0.07 

0.20 

0.53 

-0.31 

50210 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50210 

A 

1 

12 

25 

0.64 

0.47 

2.01 

0.13 

50210 

B 

0 

12 

25 

0.58 

0.25 

1.36 

0.10 

50210 

C 

0 

6 

13 

-0.42 

0.46 

0.57 

-0.26 

50210 

D 

0 

18 

38 

0.34 

0.24 

1.43 

-0.03 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50211 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50211 

A 

1 

49 

91 

0.73 

0.20 

0.82 

0.38 

50211 

B 

0 

1 

2 

0.52 

0.00 

2.15 

0.00 

50211 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50211 

D 

0 

4 

7 

-1.68 

0.96 

0.62 

-0.42 

50212 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50212 

A 

1 

48 

94 

0.51 

0.14 

1.01 

0.09 

50212 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50212 

C 

0 

2 

4 

1.06 

0.79 

3.69 

0.11 

50212 

D 

0 

1 

2 

-1.76 

0.00 

0.17 

-0.31 

50213 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

50213 

A 

1 

53 

98 

0.43 

0.17 

1.03 

0.10 

50213 

B 

0 

1 

2 

-0.47 

0.00 

0.79 

-0.10 

50213 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50214 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.03 

50214 

A 

1 

48 

84 

0.72 

0.18 

1.11 

0.28 

50214 

B 

0 

2 

4 

-0.72 

0.60 

0.51 

-0.20 

50214 

C 

0 

3 

5 

-0.28 

0.45 

0.82 

-0.16 

50214 

D 

0 

4 

7 

0.05 

0.40 

1.24 

-0.12 

50215 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50215 

A 

1 

48 

92 

0.73 

0.20 

0.94 

0.29 

50215 

B 

0 

2 

4 

-0.07 

0.50 

1.12 

-0.10 

50215 

C 

0 

2 

4 

-1.56 

1.14 

0.38 

-0.31 

50215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50216 

* 

-1 

4494 

94 

0.86 

0.02 

0.00 

-0.13 

50216 

A 

1 

257 

96 

1.67 

0.07 

0.98 

0.29 

50216 

B 

0 

6 

2 

-0.49 

0.50 

0.37 

-0.27 

50216 

C 

0 

4 

1 

0.46 

0.85 

1.27 

-0.12 

50216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50217 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

50217 

A 

1 

48 

86 

0.87 

0.20 

0.68 

0.56 

50217 

B 

0 

1 

2 

-1.41 

0.00 

0.30 

-0.17 

50217 

C 

0 

4 

7 

-2.10 

0.33 

0.18 

-0.46 

50217 

D 

0 

3 

5 

-1.06 

0.56 

0.54 

-0.24 

50218 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

0.00 

50218 

A 

1 

57 

90 

1.07 

0.18 

1.04 

0.25 

50218 

B 

0 

2 

3 

0.33 

0.36 

1.11 

-0.08 

50218 

C 

0 

3 

5 

-0.35 

0.42 

0.61 

-0.22 

50218 

D 

0 

1 

2 

-0.14 

0.00 

0.65 

-0.10 

50219 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.02 

50219 

A 

1 

40 

67 

1.11 

0.22 

0.97 

0.48 

50219 

B 

0 

12 

20 

-0.15 

0.32 

1.06 

-0.26 

50219 

C 

0 

6 

10 

-0.56 

0.30 

0.55 

-0.26 

50219 

D 

0 

2 

3 

-1.33 

2.00 

0.78 

-0.24 

50220 

* 

-1 

4700 

99 

0.91 

0.02 

0.00 

0.02 

50220 

A 

1 

55 

90 

0.83 

0.17 

0.81 

0.45 

50220 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50220 

C 

0 

3 

5 

-0.95 

0.86 

0.73 

-0.26 

50220 

D 

0 

3 

5 

-1.62 

0.38 

0.24 

-0.37 

50221 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50221 

A 

1 

38 

76 

0.49 

0.16 

1.35 

0.15 

50221 

B 

0 

4 

8 

-0.18 

0.61 

1.08 

-0.17 

50221 

C 

0 

7 

14 

0.14 

0.44 

1.73 

-0.10 

50221 

D 

0 

1 

2 

1.25 

0.00 

2.86 

0.12 

50222 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.04 

50222 

A 

1 

33 

60 

0.99 

0.21 

0.88 

0.54 

50222 

B 

0 

11 

20 

-0.67 

0.34 

0.66 

-0.42 

50222 

C 

0 

5 

9 

-0.18 

0.33 

0.82 

-0.14 

50222 

D 

0 

6 

11 

-0.27 

0.25 

0.73 

-0.18 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50223 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.02 

50223 

A 

1 

40 

78 

0.93 

0.20 

0.95 

0.34 

50223 

B 

0 

7 

14 

-0.04 

0.58 

1.50 

-0.22 

50223 

C 

0 

3 

6 

-0.80 

0.78 

0.54 

-0.28 

50223 

D 

0 

1 

2 

0.49 

0.00 

1.27 

-0.02 

50224 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50224 

A 

1 

48 

92 

0.99 

0.20 

0.58 

0.67 

50224 

B 

0 

1 

2 

-2.70 

0.00 

0.09 

-0.25 

50224 

C 

0 

1 

2 

-1.97 

0.00 

0.20 

-0.19 

50224 

D 

0 

2 

4 

-5.16 

1.23 

0.03 

-0.62 

50225 

* 

-1 

4700 

99 

0.91 

0.02 

0.00 

0.03 

50225 

A 

1 

42 

69 

0.93 

0.19 

0.84 

0.49 

50225 

B 

0 

7 

11 

-0.13 

0.24 

0.87 

-0.18 

50225 

C 

0 

3 

5 

-0.47 

0.61 

0.76 

-0.18 

50225 

D 

0 

9 

15 

-0.63 

0.33 

0.66 

-0.37 

50226 

* 

-1 

4493 

94 

0.87 

0.02 

0.00 

-0.10 

50226 

A 

1 

241 

90 

1.66 

0.08 

0.90 

0.43 

50226 

B 

0 

13 

5 

-0.35 

0.36 

0.52 

-0.32 

50226 

C 

0 

9 

3 

0.11 

0.27 

0.63 

-0.20 

50226 

D 

0 

5 

2 

-0.22 

0.69 

1.10 

-0.18 

50227 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50227 

A 

1 

43 

78 

0.79 

0.21 

1.06 

0.37 

50227 

B 

0 

5 

9 

-0.18 

0.76 

2.06 

-0.15 

50227 

C 

0 

5 

9 

-0.93 

0.66 

0.87 

-0.31 

50227 

D 

0 

2 

4 

-0.33 

0.68 

0.89 

-0.11 

50228 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50228 

A 

1 

40 

80 

0.68 

0.13 

0.89 

0.45 

50228 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50228 

C 

0 

8 

16 

-0.26 

0.34 

0.89 

-0.33 

50228 

D 

0 

2 

4 

-0.96 

0.79 

0.40 

-0.30 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50229 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50229 

A 

1 

31 

65 

0.88 

0.18 

0.71 

0.57 

50229 

B 

0 

10 

21 

-0.57 

0.41 

1.23 

-0.38 

50229 

C 

0 

2 

4 

-0.18 

0.15 

0.74 

-0.09 

50229 

D 

0 

5 

10 

-0.84 

0.37 

0.50 

-0.33 

50230 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50230 

A 

1 

41 

82 

0.79 

0.18 

1.05 

0.24 

50230 

B 

0 

5 

10 

0.04 

0.64 

1.74 

-0.18 

50230 

C 

0 

2 

4 

0.25 

0.16 

1.00 

-0.07 

50230 

D 

0 

2 

4 

-0.07 

0.46 

0.79 

-0.13 

50231 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50231 

A 

1 

40 

83 

0.75 

0.20 

0.88 

0.40 

50231 

B 

0 

3 

6 

-0.72 

1.04 

0.99 

-0.24 

50231 

C 

0 

1 

2 

-0.19 

0.00 

0.79 

-0.08 

50231 

D 

0 

4 

8 

-0.75 

0.56 

0.64 

-0.29 

50232 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.00 

50232 

A 

1 

37 

73 

1.28 

0.20 

0.78 

0.52 

50232 

B 

0 

9 

18 

-0.47 

0.39 

0.89 

-0.45 

50232 

C 

0 

4 

8 

-0.09 

0.43 

0.73 

-0.21 

50232 

D 

0 

1 

2 

0.56 

0.00 

1.08 

-0.03 

50233 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50233 

A 

1 

10 

20 

1.10 

0.43 

1.66 

0.23 

50233 

B 

0 

34 

68 

0.61 

0.14 

1.10 

-0.08 

50233 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50233 

D 

0 

6 

12 

0.25 

0.49 

0.99 

-0.16 

50234 

* 

-1 

4506 

95 

0.86 

0.02 

0.00 

-0.12 

50234 

A 

1 

183 

72 

2.07 

0.09 

0.87 

0.53 

50234 

B 

0 

23 

9 

0.67 

0.14 

0.69 

-0.21 

50234 

C 

0 

35 

14 

0.58 

0.18 

0.80 

-0.29 

50234 

D 

0 

14 

5 

-0.39 

0.36 

0.48 

-0.34 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50235 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50235 

A 

1 

42 

88 

0.59 

0.21 

1.12 

0.35 

50235 

B 

0 

2 

4 

-0.09 

0.04 

1.14 

-0.07 

50235 

C 

0 

3 

6 

-1.05 

0.20 

0.45 

-0.27 

50235 

D 

0 

1 

2 

-2.03 

0.00 

0.16 

-0.25 

50236 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.05 

50236 

A 

1 

46 

84 

0.63 

0.18 

0.77 

0.45 

50236 

B 

0 

1 

2 

-0.40 

0.00 

0.79 

-0.07 

50236 

C 

0 

2 

4 

-1.33 

0.12 

0.31 

-0.22 

50236 

D 

0 

6 

11 

-1.19 

0.93 

1.35 

-0.37 

50237 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50237 

A 

1 

34 

69 

0.58 

0.18 

1.01 

0.30 

50237 

B 

0 

3 

6 

0.03 

0.53 

1.21 

-0.08 

50237 

C 

0 

6 

12 

-0.82 

0.44 

0.59 

-0.40 

50237 

D 

0 

6 

12 

0.47 

0.32 

1.91 

0.04 

50238 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50238 

A 

1 

45 

90 

0.50 

0.17 

1.06 

0.32 

50238 

B 

0 

4 

8 

-0.82 

0.40 

0.63 

-0.30 

50238 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50238 

D 

0 

1 

2 

-0.45 

0.00 

0.73 

-0.10 

50239 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50239 

A 

1 

44 

90 

0.97 

0.24 

0.81 

0.47 

50239 

B 

0 

2 

4 

-1.17 

0.99 

0.68 

-0.22 

50239 

C 

0 

1 

2 

-2.03 

0.00 

0.19 

-0.23 

50239 

D 

0 

2 

4 

-2.09 

0.70 

0.22 

-0.33 

50240 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50240 

A 

1 

45 

90 

0.81 

0.21 

0.76 

0.46 

50240 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50240 

C 

0 

2 

4 

-2.41 

0.38 

0.12 

-0.40 

50240 

D 

0 

3 

6 

-0.92 

0.86 

0.95 

-0.25 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50241 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.00 

50241 

A 

1 

41 

82 

1.21 

0.22 

0.88 

0.48 

50241 

B 

0 

5 

10 

-0.45 

0.36 

0.69 

-0.30 

50241 

C 

0 

2 

4 

-1.12 

0.75 

0.33 

-0.27 

50241 

D 

0 

2 

4 

-0.72 

0.08 

0.38 

-0.22 

50242 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50242 

A 

1 

13 

27 

0.99 

0.33 

1.34 

0.30 

50242 

B 

0 

5 

10 

1.35 

0.37 

2.56 

0.27 

50242 

C 

0 

22 

46 

0.00 

0.20 

0.83 

-0.34 

50242 

D 

0 

8 

17 

0.08 

0.47 

0.89 

-0.13 

50243 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50243 

A 

1 

41 

79 

0.75 

0.09 

0.65 

0.73 

50243 

B 

0 

2 

4 

-0.45 

0.70 

0.69 

-0.15 

50243 

C 

0 

4 

8 

-1.32 

0.54 

0.34 

-0.45 

50243 

D 

0 

5 

10 

-1.33 

0.67 

0.39 

-0.51 

50244 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.00 

50244 

A 

1 

47 

94 

1.04 

0.23 

0.88 

0.37 

50244 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50244 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50244 

D 

0 

3 

6 

-1.52 

1.22 

0.68 

-0.37 

50245 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50245 

A 

1 

40 

80 

0.79 

0.22 

0.66 

0.60 

50245 

B 

0 

3 

6 

-1.41 

0.05 

0.36 

-0.26 

50245 

C 

0 

2 

4 

-0.18 

0.05 

1.22 

-0.06 

50245 

D 

0 

5 

10 

-2.51 

0.46 

0.18 

-0.56 

50246 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50246 

A 

1 

34 

69 

0.62 

0.23 

1.01 

0.23 

50246 

B 

0 

1 

2 

-1.56 

0.00 

0.20 

-0.21 

50246 

C 

0 

9 

18 

-0.13 

0.44 

2.07 

-0.19 

50246 

D 

0 

5 

10 

0.43 

0.66 

4.09 

0.00 



easyCBM CCSS Fifth Grade Math Measure Development 


263 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50247 

* 

-1 

4486 

94 

0.89 

0.02 

0.00 

-0.05 

50247 

A 

1 

254 

92 

1.23 

0.07 

1.01 

0.21 

50247 

B 

0 

14 

5 

0.59 

0.28 

2.22 

-0.11 

50247 

C 

0 

6 

2 

-0.35 

0.44 

0.49 

-0.19 

50247 

D 

0 

1 

0 

0.18 

0.00 

0.60 

-0.05 

50248 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50248 

A 

1 

46 

92 

0.82 

0.19 

1.04 

0.35 

50248 

B 

0 

1 

2 

-1.08 

0.00 

0.32 

-0.19 

50248 

C 

0 

3 

6 

-0.80 

0.57 

0.60 

-0.29 

50248 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50249 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50249 

A 

1 

34 

69 

1.22 

0.25 

0.73 

0.63 

50249 

B 

0 

5 

10 

-0.98 

0.23 

0.39 

-0.25 

50249 

C 

0 

5 

10 

-0.56 

0.29 

0.63 

-0.18 

50249 

D 

0 

5 

10 

-2.54 

1.08 

0.34 

-0.53 

50250 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.02 

50250 

A 

1 

29 

57 

1.15 

0.27 

1.07 

0.43 

50250 

B 

0 

7 

14 

0.16 

0.42 

1.55 

-0.15 

50250 

C 

0 

10 

20 

0.12 

0.21 

0.89 

-0.20 

50250 

D 

0 

5 

10 

-0.48 

0.30 

0.48 

-0.28 

50251 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.00 

50251 

A 

1 

48 

92 

1.01 

0.17 

1.07 

0.28 

50251 

B 

0 

2 

4 

-0.21 

0.56 

0.64 

-0.19 

50251 

C 

0 

2 

4 

-0.29 

0.29 

0.53 

-0.20 

50251 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50252 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.04 

50252 

A 

1 

49 

86 

0.72 

0.16 

0.81 

0.52 

50252 

B 

0 

7 

12 

-1.09 

0.41 

0.58 

-0.45 

50252 

C 

0 

1 

2 

-2.03 

0.00 

0.14 

-0.26 

50252 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg . Prsn Msr 

SE 

OUT.MSQ 

PTME 

50253 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50253 

A 

1 

47 

92 

0.34 

0.16 

1.10 

0.14 

50253 

B 

0 

2 

4 

- 0.16 

0.39 

1.03 

- 0.09 

50253 

C 

0 

1 

2 

- 0.57 

0.00 

0.63 

- 0.12 

50253 

D 

0 

1 

2 

0.09 

0.00 

1.23 

- 0.03 

50254 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50254 

A 

1 

44 

92 

0.64 

0.18 

0.86 

0.33 

50254 

B 

0 

2 

4 

- 0.82 

0.95 

0.68 

- 0.22 

50254 

C 

0 

1 

2 

0.57 

0.00 

1.83 

0.01 

50254 

D 

0 

1 

2 

- 2.39 

0.00 

0.10 

- 0.34 

50255 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

50255 

A 

1 

47 

98 

0.72 

0.18 

1.02 

0.17 

50255 

B 

0 

1 

2 

- 0.74 

0.00 

0.47 

- 0.17 

50255 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50255 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50256 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50256 

A 

1 

45 

88 

0.66 

0.18 

0.84 

0.36 

50256 

B 

0 

1 

2 

1.62 

0.00 

5.47 

0.12 

50256 

C 

0 

5 

10 

- 1.36 

0.76 

0.61 

- 0.44 

50256 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50257 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.00 

50257 

A 

1 

46 

94 

0.98 

0.21 

1.06 

0.08 

50257 

B 

0 

2 

4 

0.19 

1.40 

2.11 

- 0.11 

50257 

C 

0 

1 

2 

1.25 

0.00 

2.83 

0.03 

50257 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50258 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.02 

50258 

A 

1 

43 

91 

0.72 

0.16 

0.89 

0.40 

50258 

B 

0 

4 

9 

- 0.90 

0.49 

0.53 

- 0.40 

50258 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50258 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50259 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50259 

A 

1 

44 

85 

0.36 

0.16 

1.01 

0.27 

50259 

B 

0 

5 

10 

-0.59 

0.38 

0.88 

-0.25 

50259 

C 

0 

3 

6 

-0.23 

0.76 

1.39 

-0.11 

50259 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50260 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50260 

A 

1 

42 

84 

0.68 

0.18 

0.77 

0.53 

50260 

B 

0 

4 

8 

-1.05 

0.35 

0.47 

-0.31 

50260 

C 

0 

2 

4 

-1.22 

0.91 

0.49 

-0.24 

50260 

D 

0 

2 

4 

-1.69 

0.76 

0.27 

-0.32 

50261 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50261 

A 

1 

47 

94 

0.56 

0.19 

0.97 

0.26 

50261 

B 

0 

1 

2 

0.09 

0.00 

1.26 

-0.04 

50261 

C 

0 

1 

2 

-1.85 

0.00 

0.18 

-0.25 

50261 

D 

0 

1 

2 

-0.96 

0.00 

0.44 

-0.15 

50262 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.02 

50262 

A 

1 

44 

85 

0.87 

0.22 

1.07 

0.31 

50262 

B 

0 

5 

10 

-0.56 

0.41 

0.74 

-0.27 

50262 

C 

0 

2 

4 

-0.57 

1.65 

1.44 

-0.17 

50262 

D 

0 

1 

2 

0.76 

0.00 

2.01 

0.01 

50263 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50263 

A 

1 

46 

92 

0.61 

0.19 

0.96 

0.32 

50263 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50263 

C 

0 

1 

2 

-1.55 

0.00 

0.24 

-0.22 

50263 

D 

0 

3 

6 

-0.74 

0.43 

0.65 

-0.24 

50264 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50264 

A 

1 

43 

83 

0.73 

0.17 

0.91 

0.40 

50264 

B 

0 

3 

6 

-0.33 

0.22 

0.65 

-0.17 

50264 

C 

0 

3 

6 

-0.06 

0.55 

1.11 

-0.12 

50264 

D 

0 

3 

6 

-1.20 

1.10 

0.57 

-0.35 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50265 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50265 

A 

1 

36 

73 

0.70 

0.19 

1.02 

0.41 

50265 

B 

0 

3 

6 

-1.60 

0.49 

0.24 

-0.41 

50265 

C 

0 

10 

20 

-0.11 

0.33 

1.38 

-0.20 

50265 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50266 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50266 

A 

1 

43 

84 

0.66 

0.20 

1.07 

0.45 

50266 

B 

0 

1 

2 

-0.53 

0.00 

0.70 

-0.09 

50266 

C 

0 

5 

10 

-1.33 

0.35 

0.41 

-0.41 

50266 

D 

0 

2 

4 

-0.67 

0.53 

0.69 

-0.15 

50267 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

50267 

A 

1 

44 

88 

0.93 

0.17 

1.03 

0.30 

50267 

B 

0 

1 

2 

-0.71 

0.00 

0.32 

-0.20 

50267 

C 

0 

4 

8 

0.04 

0.27 

0.75 

-0.21 

50267 

D 

0 

1 

2 

0.14 

0.00 

0.74 

-0.09 

50268 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.01 

50268 

A 

1 

47 

92 

0.86 

0.17 

0.88 

0.42 

50268 

B 

0 

2 

4 

-1.31 

0.39 

0.25 

-0.33 

50268 

C 

0 

2 

4 

-0.79 

0.01 

0.39 

-0.25 

50268 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50269 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.02 

50269 

A 

1 

43 

84 

0.71 

0.19 

1.26 

0.13 

50269 

B 

0 

4 

8 

0.86 

0.53 

2.80 

0.05 

50269 

C 

0 

3 

6 

-0.22 

0.60 

0.92 

-0.18 

50269 

D 

0 

1 

2 

-0.49 

0.00 

0.50 

-0.13 

50270 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

50270 

A 

1 

48 

87 

0.78 

0.17 

1.05 

0.36 

50270 

B 

0 

2 

4 

-0.05 

0.21 

0.89 

-0.10 

50270 

C 

0 

4 

7 

-0.48 

0.41 

0.72 

-0.25 

50270 

D 

0 

1 

2 

-1.75 

0.00 

0.16 

-0.26 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50271 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.07 

50271 

A 

1 

19 

38 

0.50 

0.21 

1.04 

0.35 

50271 

B 

0 

6 

12 

-0.77 

0.56 

0.75 

-0.29 

50271 

C 

0 

25 

50 

-0.12 

0.19 

1.13 

-0.15 

50271 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50272 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50272 

A 

1 

42 

86 

0.41 

0.18 

1.03 

0.30 

50272 

B 

0 

1 

2 

0.07 

0.00 

1.21 

-0.03 

50272 

C 

0 

5 

10 

-0.87 

0.41 

0.60 

-0.33 

50272 

D 

0 

1 

2 

0.33 

0.00 

1.58 

0.01 

50273 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50273 

A 

1 

48 

94 

0.36 

0.16 

1.03 

0.20 

50273 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50273 

C 

0 

1 

2 

0.29 

0.00 

1.66 

0.00 

50273 

D 

0 

2 

4 

-1.06 

0.62 

0.51 

-0.24 

50274 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50274 

A 

1 

34 

71 

0.84 

0.15 

0.91 

0.45 

50274 

B 

0 

13 

27 

-0.13 

0.21 

0.78 

-0.45 

50274 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50274 

D 

0 

1 

2 

0.37 

0.00 

0.97 

-0.03 

50275 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50275 

A 

1 

43 

88 

0.37 

0.21 

1.93 

0.11 

50275 

B 

0 

3 

6 

-0.48 

0.48 

1.02 

-0.15 

50275 

C 

0 

1 

2 

0.98 

0.00 

3.47 

0.07 

50275 

D 

0 

2 

4 

0.00 

0.93 

1.93 

-0.05 

50276 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50276 

A 

1 

43 

83 

0.44 

0.14 

0.85 

0.49 

50276 

B 

0 

1 

2 

-0.98 

0.00 

0.40 

-0.17 

50276 

C 

0 

8 

15 

-0.85 

0.34 

0.68 

-0.45 

50276 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50277 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.02 

50277 

A 

1 

48 

89 

0.88 

0.18 

0.79 

0.50 

50277 

B 

0 

3 

6 

-1.49 

1.24 

0.57 

-0.35 

50277 

C 

0 

2 

4 

-1.95 

0.75 

0.20 

-0.35 

50277 

D 

0 

1 

2 

-0.18 

0.00 

0.88 

-0.08 

50278 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50278 

A 

1 

49 

94 

0.47 

0.14 

0.91 

0.27 

50278 

B 

0 

1 

2 

0.55 

0.00 

1.70 

0.02 

50278 

C 

0 

2 

4 

-1.30 

0.83 

0.36 

-0.34 

50278 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50279 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50279 

A 

1 

44 

92 

0.42 

0.15 

0.96 

0.27 

50279 

B 

0 

4 

8 

-0.63 

0.66 

1.07 

-0.27 

50279 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50279 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50280 

* 

-1 

4492 

94 

0.87 

0.02 

0.00 

-0.09 

50280 

A 

1 

253 

94 

1.50 

0.07 

0.92 

0.33 

50280 

B 

0 

2 

1 

-1.26 

0.03 

0.12 

-0.20 

50280 

C 

0 

13 

5 

0.01 

0.27 

0.56 

-0.27 

50280 

D 

0 

1 

0 

0.11 

0.00 

0.46 

-0.07 

50281 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.02 

50281 

A 

1 

49 

92 

0.77 

0.19 

0.82 

0.39 

50281 

B 

0 

1 

2 

-2.58 

0.00 

0.08 

-0.31 

50281 

C 

0 

3 

6 

-0.95 

0.47 

0.49 

-0.27 

50281 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50282 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50282 

A 

1 

46 

88 

0.45 

0.19 

1.82 

0.27 

50282 

B 

0 

2 

4 

-0.68 

1.10 

1.05 

-0.15 

50282 

C 

0 

2 

4 

-0.63 

0.47 

0.74 

-0.15 

50282 

D 

0 

2 

4 

-0.61 

0.37 

0.72 

-0.14 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50283 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.08 

50283 

A 

1 

47 

90 

-0.02 

0.14 

0.95 

0.30 

50283 

B 

0 

2 

4 

0.12 

0.23 

1.92 

0.05 

50283 

C 

0 

3 

6 

-1.82 

0.24 

0.28 

-0.42 

50283 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50284 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50284 

A 

1 

42 

81 

0.51 

0.15 

0.82 

0.56 

50284 

B 

0 

4 

8 

-1.44 

0.36 

0.35 

-0.41 

50284 

C 

0 

5 

10 

-1.21 

0.27 

0.40 

-0.40 

50284 

D 

0 

1 

2 

0.71 

0.00 

2.40 

0.06 

50285 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50285 

A 

1 

45 

87 

0.79 

0.18 

0.76 

0.50 

50285 

B 

0 

3 

6 

-0.48 

0.40 

0.73 

-0.18 

50285 

C 

0 

3 

6 

-2.14 

0.35 

0.14 

-0.48 

50285 

D 

0 

1 

2 

-0.69 

0.00 

0.52 

-0.12 

50286 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50286 

A 

1 

43 

86 

0.60 

0.15 

0.76 

0.60 

50286 

B 

0 

2 

4 

-1.58 

0.26 

0.24 

-0.33 

50286 

C 

0 

2 

4 

-1.65 

0.26 

0.23 

-0.34 

50286 

D 

0 

3 

6 

-1.22 

0.59 

0.48 

-0.33 

50287 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.07 

50287 

A 

1 

43 

84 

0.25 

0.15 

0.83 

0.50 

50287 

B 

0 

4 

8 

-1.16 

0.32 

0.50 

-0.32 

50287 

C 

0 

2 

4 

-2.04 

0.13 

0.18 

-0.39 

50287 

D 

0 

2 

4 

-0.55 

0.38 

0.84 

-0.11 

50288 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.05 

50288 

A 

1 

54 

96 

0.41 

0.16 

1.07 

0.28 

50288 

B 

0 

1 

2 

-0.71 

0.00 

0.70 

-0.12 

50288 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50288 

D 

0 

1 

2 

-2.18 

0.00 

0.16 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50289 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

50289 

A 

1 

17 

34 

1.54 

0.45 

3.28 

0.40 

50289 

B 

0 

12 

24 

0.07 

0.27 

0.61 

-0.24 

50289 

C 

0 

3 

6 

1.51 

0.74 

2.81 

0.13 

50289 

D 

0 

18 

36 

0.21 

0.26 

0.86 

-0.25 

50290 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.01 

50290 

A 

1 

23 

45 

1.21 

0.32 

1.54 

0.26 

50290 

B 

0 

13 

25 

0.73 

0.39 

2.42 

-0.03 

50290 

C 

0 

1 

2 

0.00 

0.00 

0.46 

-0.08 

50290 

D 

0 

14 

27 

0.24 

0.35 

1.36 

-0.24 

50291 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

50291 

A 

1 

27 

51 

0.30 

0.21 

2.20 

0.03 

50291 

B 

0 

7 

13 

0.51 

0.24 

1.57 

0.10 

50291 

C 

0 

4 

8 

0.06 

0.29 

0.93 

-0.06 

50291 

D 

0 

15 

28 

0.16 

0.23 

1.28 

-0.07 

50292 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.04 

50292 

A 

1 

20 

36 

0.97 

0.30 

1.20 

0.29 

50292 

B 

0 

12 

21 

0.73 

0.36 

3.84 

0.11 

50292 

C 

0 

10 

18 

-0.16 

0.37 

0.87 

-0.21 

50292 

D 

0 

14 

25 

-0.12 

0.34 

0.87 

-0.25 

50293 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50293 

A 

1 

14 

27 

1.48 

0.29 

0.56 

0.56 

50293 

B 

0 

7 

13 

0.32 

0.72 

5.80 

0.01 

50293 

C 

0 

7 

13 

-0.41 

0.28 

0.52 

-0.21 

50293 

D 

0 

24 

46 

-0.22 

0.18 

0.71 

-0.36 

50294 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.02 

50294 

A 

1 

17 

33 

1.32 

0.30 

1.16 

0.34 

50294 

B 

0 

5 

10 

-0.56 

0.60 

0.40 

-0.25 

50294 

C 

0 

9 

18 

1.10 

0.37 

2.01 

0.16 

50294 

D 

0 

20 

39 

0.02 

0.37 

0.96 

-0.30 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50295 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50295 

A 

1 

35 

67 

0.40 

0.22 

1.45 

0.16 

50295 

B 

0 

14 

27 

0.11 

0.23 

1.39 

-0.08 

50295 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50295 

D 

0 

3 

6 

-0.48 

0.73 

0.86 

-0.16 

50296 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50296 

A 

1 

37 

71 

0.70 

0.20 

1.13 

0.35 

50296 

B 

0 

14 

27 

-0.13 

0.21 

0.99 

-0.29 

50296 

C 

0 

1 

2 

-1.48 

0.00 

0.20 

-0.22 

50296 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50297 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.02 

50297 

A 

1 

40 

68 

1.02 

0.21 

1.01 

0.41 

50297 

B 

0 

3 

5 

-0.13 

0.35 

0.73 

-0.13 

50297 

C 

0 

13 

22 

-0.06 

0.34 

1.25 

-0.27 

50297 

D 

0 

3 

5 

-0.71 

0.71 

0.52 

-0.23 

50298 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50298 

A 

1 

34 

67 

0.44 

0.25 

1.21 

0.26 

50298 

B 

0 

15 

29 

-0.20 

0.26 

1.35 

-0.19 

50298 

C 

0 

1 

2 

-1.44 

0.00 

0.26 

-0.17 

50298 

D 

0 

1 

2 

-0.43 

0.00 

0.72 

-0.07 

50299 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.03 

50299 

A 

1 

40 

67 

0.86 

0.19 

1.37 

0.34 

50299 

B 

0 

17 

28 

0.15 

0.16 

0.96 

-0.24 

50299 

C 

0 

1 

2 

-0.78 

0.00 

0.31 

-0.16 

50299 

D 

0 

2 

3 

-0.58 

0.67 

0.46 

-0.19 

50300 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.06 

50300 

A 

1 

27 

53 

0.36 

0.22 

1.48 

0.24 

50300 

B 

0 

9 

18 

-0.19 

0.44 

1.16 

-0.11 

50300 

C 

0 

12 

24 

-0.17 

0.33 

1.23 

-0.13 

50300 

D 

0 

3 

6 

-0.37 

0.50 

0.81 

-0.10 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50301 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50301 

A 

1 

42 

81 

0.74 

0.20 

1.18 

0.36 

50301 

B 

0 

8 

15 

0.01 

0.30 

1.10 

-0.12 

50301 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50301 

D 

0 

2 

4 

-3.42 

2.97 

0.53 

-0.50 

50302 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50302 

A 

1 

39 

76 

0.64 

0.17 

0.76 

0.55 

50302 

B 

0 

4 

8 

-0.18 

0.50 

1.43 

-0.10 

50302 

C 

0 

7 

14 

-1.35 

0.35 

0.46 

-0.51 

50302 

D 

0 

1 

2 

-1.76 

0.00 

0.19 

-0.23 

50303 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50303 

A 

1 

41 

84 

0.96 

0.20 

0.80 

0.53 

50303 

B 

0 

1 

2 

-1.86 

0.00 

0.14 

-0.26 

50303 

C 

0 

6 

12 

-0.89 

0.29 

0.47 

-0.41 

50303 

D 

0 

1 

2 

-0.93 

0.00 

0.37 

-0.16 

50304 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.06 

50304 

A 

1 

41 

82 

0.37 

0.20 

1.02 

0.39 

50304 

B 

0 

2 

4 

-0.81 

0.51 

0.67 

-0.15 

50304 

C 

0 

5 

10 

-0.81 

0.19 

0.63 

-0.25 

50304 

D 

0 

2 

4 

-1.31 

0.29 

0.37 

-0.23 

50305 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50305 

A 

1 

42 

82 

0.75 

0.18 

0.86 

0.53 

50305 

B 

0 

5 

10 

-0.75 

0.27 

0.54 

-0.32 

50305 

C 

0 

3 

6 

-1.38 

0.23 

0.27 

-0.37 

50305 

D 

0 

1 

2 

-1.05 

0.00 

0.35 

-0.17 

50306 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50306 

A 

1 

39 

75 

0.94 

0.20 

0.97 

0.52 

50306 

B 

0 

4 

8 

0.40 

0.50 

1.99 

-0.03 

50306 

C 

0 

6 

12 

-1.23 

0.32 

0.32 

-0.46 

50306 

D 

0 

3 

6 

-1.13 

0.25 

0.30 

-0.30 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50307 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50307 

A 

1 

39 

78 

0.66 

0.21 

0.94 

0.43 

50307 

B 

0 

3 

6 

-0.72 

0.36 

0.61 

-0.20 

50307 

C 

0 

4 

8 

-1.12 

0.52 

0.51 

-0.32 

50307 

D 

0 

4 

8 

-0.42 

0.63 

1.19 

-0.17 

50308 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.02 

50308 

A 

1 

43 

75 

0.96 

0.15 

0.95 

0.48 

50308 

B 

0 

1 

2 

-0.93 

0.00 

0.27 

-0.18 

50308 

C 

0 

7 

12 

-0.40 

0.56 

1.41 

-0.34 

50308 

D 

0 

6 

11 

-0.14 

0.38 

0.90 

-0.23 

50309 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50309 

A 

1 

43 

81 

0.70 

0.16 

0.99 

0.39 

50309 

B 

0 

4 

8 

-0.06 

0.35 

0.93 

-0.14 

50309 

C 

0 

3 

6 

-0.57 

0.35 

0.53 

-0.24 

50309 

D 

0 

3 

6 

-0.66 

0.68 

0.69 

-0.26 

50310 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.01 

50310 

A 

1 

47 

84 

0.99 

0.14 

0.78 

0.56 

50310 

B 

0 

2 

4 

-0.86 

0.07 

0.30 

-0.28 

50310 

C 

0 

2 

4 

-0.95 

0.97 

0.41 

-0.29 

50310 

D 

0 

5 

9 

-0.49 

0.50 

0.68 

-0.35 

50311 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50311 

A 

1 

33 

69 

0.88 

0.21 

0.96 

0.57 

50311 

B 

0 

4 

8 

-1.02 

0.65 

0.59 

-0.31 

50311 

C 

0 

8 

17 

-0.75 

0.30 

0.63 

-0.37 

50311 

D 

0 

3 

6 

-0.57 

0.39 

0.62 

-0.18 

50312 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50312 

A 

1 

32 

59 

0.83 

0.15 

1.10 

0.37 

50312 

B 

0 

12 

22 

0.38 

0.31 

1.39 

-0.07 

50312 

C 

0 

4 

7 

0.22 

0.11 

0.78 

-0.08 

50312 

D 

0 

6 

11 

-0.68 

0.59 

0.57 

-0.41 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50313 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.04 

50313 

A 

1 

15 

27 

1.08 

0.29 

1.27 

0.33 

50313 

B 

0 

12 

22 

0.25 

0.35 

1.31 

-0.07 

50313 

C 

0 

22 

40 

0.41 

0.21 

1.19 

0.00 

50313 

D 

0 

6 

11 

-0.89 

0.62 

0.33 

-0.37 

50314 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50314 

A 

1 

34 

64 

0.75 

0.23 

0.93 

0.39 

50314 

B 

0 

12 

23 

-0.12 

0.30 

1.37 

-0.19 

50314 

C 

0 

1 

2 

1.11 

0.00 

2.92 

0.08 

50314 

D 

0 

6 

11 

-1.03 

0.28 

0.42 

-0.37 

50315 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50315 

A 

1 

33 

63 

0.87 

0.16 

0.83 

0.55 

50315 

B 

0 

13 

25 

-0.24 

0.21 

0.73 

-0.38 

50315 

C 

0 

3 

6 

-0.17 

0.36 

0.69 

-0.15 

50315 

D 

0 

3 

6 

-0.71 

0.59 

0.52 

-0.28 

50316 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50316 

A 

1 

39 

75 

0.76 

0.19 

0.98 

0.42 

50316 

B 

0 

10 

19 

-0.27 

0.22 

0.84 

-0.30 

50316 

C 

0 

2 

4 

-0.97 

1.15 

0.57 

-0.24 

50316 

D 

0 

1 

2 

-0.65 

0.00 

0.45 

-0.13 

50317 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50317 

A 

1 

32 

62 

0.54 

0.17 

0.99 

0.35 

50317 

B 

0 

13 

25 

-0.01 

0.35 

1.90 

-0.13 

50317 

C 

0 

4 

8 

-0.28 

0.48 

0.92 

-0.14 

50317 

D 

0 

3 

6 

-1.16 

0.50 

0.36 

-0.32 

50318 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50318 

A 

1 

38 

69 

0.84 

0.15 

0.91 

0.44 

50318 

B 

0 

13 

24 

0.03 

0.24 

0.97 

-0.30 

50318 

C 

0 

3 

5 

-0.67 

0.17 

0.36 

-0.30 

50318 

D 

0 

1 

2 

0.06 

0.00 

0.72 

-0.07 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50319 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.03 

50319 

A 

1 

40 

69 

0.90 

0.15 

0.98 

0.50 

50319 

B 

0 

11 

19 

-0.27 

0.25 

0.66 

-0.39 

50319 

C 

0 

5 

9 

0.13 

0.22 

0.84 

-0.13 

50319 

D 

0 

2 

3 

-0.70 

0.04 

0.34 

-0.23 

50320 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

50320 

A 

1 

33 

62 

0.74 

0.23 

1.36 

0.46 

50320 

B 

0 

4 

8 

-0.18 

0.43 

0.99 

-0.09 

50320 

C 

0 

10 

19 

-0.31 

0.36 

1.14 

-0.19 

50320 

D 

0 

6 

11 

-1.30 

0.55 

0.46 

-0.39 

50321 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

50321 

A 

1 

35 

64 

0.89 

0.23 

1.56 

0.23 

50321 

B 

0 

14 

25 

0.38 

0.29 

1.60 

-0.13 

50321 

C 

0 

3 

5 

-0.48 

0.33 

0.42 

-0.22 

50321 

D 

0 

3 

5 

0.58 

1.02 

3.01 

-0.02 

50322 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50322 

A 

1 

31 

63 

0.89 

0.19 

0.73 

0.57 

50322 

B 

0 

4 

8 

-0.71 

0.19 

0.45 

-0.25 

50322 

C 

0 

7 

14 

-0.46 

0.19 

0.59 

-0.26 

50322 

D 

0 

7 

14 

-0.68 

0.64 

1.08 

-0.33 

50323 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.04 

50323 

A 

1 

24 

41 

0.94 

0.19 

0.91 

0.41 

50323 

B 

0 

8 

14 

0.22 

0.32 

1.07 

-0.06 

50323 

C 

0 

20 

34 

0.25 

0.24 

1.24 

-0.09 

50323 

D 

0 

7 

12 

-0.91 

0.37 

0.35 

-0.43 

50324 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.00 

50324 

A 

1 

23 

43 

1.86 

0.27 

0.80 

0.61 

50324 

B 

0 

8 

15 

0.07 

0.46 

0.96 

-0.26 

50324 

C 

0 

12 

23 

0.31 

0.23 

0.74 

-0.24 

50324 

D 

0 

10 

19 

0.13 

0.30 

0.65 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50325 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50325 

A 

1 

28 

55 

0.79 

0.23 

1.11 

0.43 

50325 

B 

0 

13 

25 

-0.45 

0.38 

0.85 

-0.35 

50325 

C 

0 

5 

10 

0.06 

0.36 

1.11 

-0.06 

50325 

D 

0 

5 

10 

-0.25 

0.24 

0.67 

-0.15 

50326 

* 

-1 

4716 

99 

0.90 

0.02 

0.00 

0.02 

50326 

A 

1 

22 

49 

1.07 

0.24 

1.06 

0.40 

50326 

B 

0 

11 

24 

0.00 

0.28 

0.78 

-0.32 

50326 

C 

0 

8 

18 

0.52 

0.34 

1.23 

-0.04 

50326 

D 

0 

4 

9 

0.05 

0.45 

0.81 

-0.16 

50327 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.01 

50327 

A 

1 

34 

59 

1.24 

0.21 

0.99 

0.48 

50327 

B 

0 

7 

12 

0.11 

0.30 

0.83 

-0.19 

50327 

C 

0 

7 

12 

-0.37 

0.21 

0.44 

-0.34 

50327 

D 

0 

10 

17 

0.30 

0.35 

1.33 

-0.17 

50328 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50328 

A 

1 

27 

54 

1.21 

0.28 

0.78 

0.59 

50328 

B 

0 

6 

12 

-0.92 

0.20 

0.37 

-0.32 

50328 

C 

0 

8 

16 

-0.09 

0.37 

1.28 

-0.14 

50328 

D 

0 

9 

18 

-0.80 

0.26 

0.49 

-0.37 

50329 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50329 

A 

1 

30 

61 

0.88 

0.22 

1.04 

0.42 

50329 

B 

0 

7 

14 

-0.76 

0.33 

0.51 

-0.41 

50329 

C 

0 

3 

6 

1.10 

0.45 

2.81 

0.13 

50329 

D 

0 

9 

18 

-0.13 

0.23 

0.78 

-0.24 

50330 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

50330 

A 

1 

15 

28 

1.17 

0.29 

0.84 

0.43 

50330 

B 

0 

19 

35 

0.45 

0.25 

2.06 

0.04 

50330 

C 

0 

15 

28 

-0.14 

0.21 

0.63 

-0.28 

50330 

D 

0 

5 

9 

-0.63 

0.38 

0.40 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50331 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.05 

50331 

A 

1 

26 

47 

1.05 

0.25 

0.82 

0.58 

50331 

B 

0 

7 

13 

-0.21 

0.26 

0.76 

-0.13 

50331 

C 

0 

6 

11 

-0.22 

0.40 

0.85 

-0.12 

50331 

D 

0 

16 

29 

-0.69 

0.25 

0.55 

-0.45 

50332 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.05 

50332 

A 

1 

35 

61 

0.86 

0.19 

0.76 

0.55 

50332 

B 

0 

4 

7 

-0.52 

0.16 

0.55 

-0.18 

50332 

C 

0 

8 

14 

-0.67 

0.43 

0.85 

-0.31 

50332 

D 

0 

10 

18 

-0.52 

0.35 

1.00 

-0.30 

50333 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50333 

A 

1 

35 

67 

0.80 

0.24 

1.07 

0.38 

50333 

B 

0 

4 

8 

-0.34 

0.36 

0.82 

-0.17 

50333 

C 

0 

5 

10 

-0.18 

0.47 

1.08 

-0.15 

50333 

D 

0 

8 

15 

-0.31 

0.31 

0.91 

-0.24 

50334 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50334 

A 

1 

34 

65 

0.79 

0.14 

0.91 

0.42 

50334 

B 

0 

11 

21 

0.10 

0.32 

1.05 

-0.24 

50334 

C 

0 

2 

4 

-0.25 

0.32 

0.53 

-0.17 

50334 

D 

0 

5 

10 

-0.13 

0.39 

0.73 

-0.23 

50335 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50335 

A 

1 

39 

74 

1.10 

0.21 

1.16 

0.36 

50335 

B 

0 

3 

6 

-0.11 

0.12 

0.60 

-0.17 

50335 

C 

0 

1 

2 

1.14 

0.00 

2.05 

0.03 

50335 

D 

0 

10 

19 

-0.04 

0.37 

1.02 

-0.31 

50336 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.01 

50336 

A 

1 

31 

60 

1.15 

0.18 

0.90 

0.51 

50336 

B 

0 

7 

13 

0.03 

0.23 

0.66 

-0.26 

50336 

C 

0 

6 

12 

0.48 

0.48 

1.62 

-0.08 

50336 

D 

0 

8 

15 

-0.19 

0.16 

0.49 

-0.37 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50337 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.00 

50337 

A 

1 

28 

53 

1.69 

0.26 

0.67 

0.60 

50337 

B 

0 

6 

11 

0.20 

0.47 

1.14 

-0.18 

50337 

C 

0 

9 

17 

-0.05 

0.24 

0.65 

-0.31 

50337 

D 

0 

10 

19 

-0.06 

0.22 

0.59 

-0.33 

50338 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50338 

A 

1 

30 

58 

1.16 

0.18 

0.80 

0.56 

50338 

B 

0 

7 

13 

0.38 

0.47 

2.30 

-0.06 

50338 

C 

0 

5 

10 

-0.04 

0.37 

0.77 

-0.16 

50338 

D 

0 

10 

19 

-0.79 

0.36 

0.43 

-0.53 

50339 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50339 

A 

1 

26 

53 

1.27 

0.23 

1.00 

0.53 

50339 

B 

0 

9 

18 

-0.43 

0.27 

0.51 

-0.41 

50339 

C 

0 

7 

14 

0.24 

0.33 

1.07 

-0.13 

50339 

D 

0 

7 

14 

0.14 

0.49 

1.37 

-0.17 

50340 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.02 

50340 

A 

1 

27 

53 

1.62 

0.24 

0.66 

0.60 

50340 

B 

0 

6 

12 

-0.34 

0.26 

0.48 

-0.20 

50340 

C 

0 

6 

12 

-0.53 

0.58 

0.69 

-0.24 

50340 

D 

0 

12 

24 

-0.51 

0.58 

0.79 

-0.37 

50341 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50341 

A 

1 

39 

75 

0.65 

0.18 

1.06 

0.26 

50341 

B 

0 

3 

6 

0.31 

0.64 

1.68 

-0.04 

50341 

C 

0 

7 

13 

0.09 

0.33 

1.15 

-0.14 

50341 

D 

0 

3 

6 

-0.58 

0.76 

0.82 

-0.24 

50342 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.02 

50342 

A 

1 

44 

81 

0.88 

0.17 

0.89 

0.46 

50342 

B 

0 

1 

2 

-0.26 

0.00 

0.59 

-0.10 

50342 

C 

0 

7 

13 

-0.19 

0.21 

0.72 

-0.27 

50342 

D 

0 

2 

4 

-1.73 

0.05 

0.14 

-0.40 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50343 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50343 

A 

1 

27 

53 

1.44 

0.24 

0.70 

0.63 

50343 

B 

0 

5 

10 

0.28 

0.49 

1.28 

-0.02 

50343 

C 

0 

7 

14 

-0.36 

0.29 

0.62 

-0.17 

50343 

D 

0 

12 

24 

-1.54 

0.50 

0.31 

-0.60 

50344 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

50344 

A 

1 

45 

83 

0.72 

0.19 

0.83 

0.51 

50344 

B 

0 

4 

7 

-1.04 

0.35 

0.47 

-0.31 

50344 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50344 

D 

0 

5 

9 

-1.17 

0.26 

0.39 

-0.38 

50345 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.06 

50345 

A 

1 

38 

76 

0.36 

0.19 

1.01 

0.29 

50345 

B 

0 

3 

6 

-0.04 

0.38 

1.26 

-0.04 

50345 

C 

0 

6 

12 

0.15 

0.29 

1.63 

-0.01 

50345 

D 

0 

3 

6 

-2.03 

0.66 

0.21 

-0.46 

50346 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.06 

50346 

A 

1 

45 

82 

0.38 

0.16 

1.00 

0.40 

50346 

B 

0 

3 

5 

-0.21 

0.26 

1.04 

-0.08 

50346 

C 

0 

3 

5 

-0.35 

0.72 

1.37 

-0.11 

50346 

D 

0 

4 

7 

-1.64 

0.26 

0.26 

-0.44 

50347 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50347 

A 

1 

41 

84 

0.94 

0.18 

0.96 

0.40 

50347 

B 

0 

2 

4 

-1.30 

0.62 

0.24 

-0.34 

50347 

C 

0 

5 

10 

-0.10 

0.49 

0.95 

-0.23 

50347 

D 

0 

1 

2 

0.24 

0.00 

0.94 

-0.06 

50348 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.04 

50348 

A 

1 

28 

48 

0.90 

0.25 

1.36 

0.33 

50348 

B 

0 

13 

22 

-0.16 

0.22 

0.68 

-0.27 

50348 

C 

0 

7 

12 

0.83 

0.41 

2.49 

0.11 

50348 

D 

0 

10 

17 

-0.18 

0.44 

1.10 

-0.23 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50349 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.02 

50349 

A 

1 

43 

77 

0.92 

0.18 

0.98 

0.40 

50349 

B 

0 

4 

7 

0.95 

0.32 

2.25 

0.07 

50349 

C 

0 

1 

2 

-0.55 

0.00 

0.44 

-0.13 

50349 

D 

0 

8 

14 

-0.87 

0.36 

0.51 

-0.48 

50350 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50350 

A 

1 

49 

91 

0.63 

0.16 

1.01 

0.34 

50350 

B 

0 

3 

6 

-0.30 

0.14 

0.73 

-0.18 

50350 

C 

0 

1 

2 

-1.54 

0.00 

0.21 

-0.25 

50350 

D 

0 

1 

2 

-0.98 

0.00 

0.36 

-0.18 

50351 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

50351 

A 

1 

28 

51 

1.23 

0.26 

1.07 

0.46 

50351 

B 

0 

14 

25 

0.08 

0.23 

1.03 

-0.24 

50351 

C 

0 

11 

20 

0.06 

0.36 

1.09 

-0.21 

50351 

D 

0 

2 

4 

-0.96 

1.17 

0.41 

-0.23 

50352 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50352 

A 

1 

26 

52 

0.67 

0.23 

1.16 

0.40 

50352 

B 

0 

10 

20 

-0.09 

0.24 

0.94 

-0.13 

50352 

C 

0 

10 

20 

-0.36 

0.38 

0.91 

-0.25 

50352 

D 

0 

4 

8 

-0.51 

0.70 

1.03 

-0.18 

50353 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50353 

A 

1 

34 

67 

0.95 

0.27 

1.18 

0.43 

50353 

B 

0 

7 

14 

-0.76 

0.14 

0.46 

-0.34 

50353 

C 

0 

9 

18 

-0.12 

0.30 

1.30 

-0.20 

50353 

D 

0 

1 

2 

-0.04 

0.00 

0.89 

-0.05 

50354 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

50354 

A 

1 

29 

55 

0.74 

0.22 

0.94 

0.41 

50354 

B 

0 

13 

25 

-0.13 

0.30 

1.24 

-0.18 

50354 

C 

0 

9 

17 

-0.50 

0.44 

0.98 

-0.28 

50354 

D 

0 

2 

4 

-0.56 

0.61 

0.58 

-0.13 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50355 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50355 

A 

1 

32 

63 

0.84 

0.17 

0.96 

0.44 

50355 

B 

0 

7 

14 

-0.05 

0.43 

0.97 

-0.19 

50355 

C 

0 

10 

20 

-0.12 

0.30 

1.03 

-0.27 

50355 

D 

0 

2 

4 

-0.58 

0.45 

0.44 

-0.20 

50356 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50356 

A 

1 

33 

61 

0.84 

0.21 

1.30 

0.29 

50356 

B 

0 

5 

9 

0.69 

0.39 

1.94 

0.04 

50356 

C 

0 

9 

17 

0.14 

0.38 

1.26 

-0.16 

50356 

D 

0 

7 

13 

-0.32 

0.34 

0.61 

-0.28 

50357 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.01 

50357 

A 

1 

41 

75 

0.98 

0.17 

1.15 

0.34 

50357 

B 

0 

5 

9 

-0.23 

0.21 

0.50 

-0.31 

50357 

C 

0 

3 

5 

0.45 

0.65 

1.29 

-0.07 

50357 

D 

0 

6 

11 

0.37 

0.20 

0.94 

-0.13 

50358 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.02 

50358 

A 

1 

38 

72 

1.09 

0.19 

0.83 

0.53 

50358 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50358 

C 

0 

10 

19 

-0.22 

0.23 

0.72 

-0.33 

50358 

D 

0 

5 

9 

-0.84 

0.49 

0.46 

-0.38 

50359 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50359 

A 

1 

30 

57 

0.78 

0.20 

1.05 

0.37 

50359 

B 

0 

17 

32 

0.04 

0.20 

0.98 

-0.28 

50359 

C 

0 

3 

6 

-0.05 

0.38 

0.77 

-0.12 

50359 

D 

0 

3 

6 

-0.05 

0.33 

0.74 

-0.12 

50360 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.02 

50360 

A 

1 

30 

57 

1.14 

0.27 

1.11 

0.43 

50360 

B 

0 

15 

28 

0.31 

0.23 

1.29 

-0.13 

50360 

C 

0 

3 

6 

-0.58 

0.66 

0.58 

-0.20 

50360 

D 

0 

5 

9 

-1.04 

0.33 

0.31 

-0.37 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50361 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50361 

A 

1 

49 

94 

0.35 

0.14 

0.90 

0.42 

50361 

B 

0 

3 

6 

-1.47 

0.35 

0.31 

-0.42 

50361 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50361 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50362 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50362 

A 

1 

46 

87 

0.97 

0.20 

0.86 

0.42 

50362 

B 

0 

1 

2 

-1.68 

0.00 

0.17 

-0.23 

50362 

C 

0 

6 

11 

-0.68 

0.45 

0.72 

-0.35 

50362 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50363 

* 

-1 

1976 

42 

1.44 

0.03 

0.00 

0.34 

50363 

A 

1 

2521 

91 

0.67 

0.02 

0.97 

0.36 

50363 

B 

0 

97 

3 

-0.60 

0.10 

1.01 

-0.16 

50363 

C 

0 

105 

4 

-0.76 

0.09 

0.76 

-0.19 

50363 

D 

0 

62 

2 

-1.70 

0.19 

0.44 

-0.26 

50364 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50364 

A 

1 

48 

89 

0.73 

0.20 

0.96 

0.34 

50364 

B 

0 

2 

4 

-0.65 

0.46 

0.63 

-0.17 

50364 

C 

0 

3 

6 

-0.59 

0.57 

0.79 

-0.20 

50364 

D 

0 

1 

2 

-1.80 

0.00 

0.18 

-0.23 

50365 

* 

-1 

4471 

94 

0.86 

0.02 

0.00 

-0.11 

50365 

A 

1 

127 

44 

2.14 

0.11 

1.25 

0.46 

50365 

B 

0 

39 

13 

0.63 

0.16 

0.64 

-0.28 

50365 

C 

0 

122 

42 

1.13 

0.08 

0.94 

-0.25 

50365 

D 

0 

2 

1 

-0.57 

0.22 

0.13 

-0.14 

50366 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.02 

50366 

A 

1 

50 

94 

0.70 

0.20 

1.07 

0.19 

50366 

B 

0 

1 

2 

-0.58 

0.00 

0.61 

-0.12 

50366 

C 

0 

1 

2 

-0.66 

0.00 

0.56 

-0.13 

50366 

D 

0 

1 

2 

-0.11 

0.00 

0.97 

-0.08 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50367 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50367 

A 

1 

45 

90 

0.78 

0.18 

0.92 

0.28 

50367 

B 

0 

1 

2 

1.08 

0.00 

2.64 

0.05 

50367 

C 

0 

2 

4 

0.19 

0.54 

1.25 

-0.07 

50367 

D 

0 

2 

4 

-1.75 

1.34 

0.32 

-0.38 

50368 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50368 

A 

1 

34 

65 

0.96 

0.18 

0.99 

0.45 

50368 

B 

0 

14 

27 

0.04 

0.27 

0.91 

-0.30 

50368 

C 

0 

1 

2 

-1.07 

0.00 

0.22 

-0.21 

50368 

D 

0 

3 

6 

-0.42 

0.48 

0.52 

-0.23 

50369 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50369 

A 

1 

24 

45 

1.08 

0.27 

1.19 

0.48 

50369 

B 

0 

2 

4 

-0.83 

0.89 

0.39 

-0.21 

50369 

C 

0 

21 

40 

-0.01 

0.18 

0.85 

-0.30 

50369 

D 

0 

6 

11 

-0.09 

0.36 

0.75 

-0.16 

50370 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.01 

50370 

A 

1 

11 

22 

2.01 

0.56 

2.20 

0.47 

50370 

B 

0 

5 

10 

-0.86 

0.45 

0.23 

-0.37 

50370 

C 

0 

29 

57 

0.65 

0.16 

0.96 

-0.07 

50370 

D 

0 

6 

12 

0.18 

0.56 

0.68 

-0.15 

50371 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.05 

50371 

A 

1 

25 

46 

0.94 

0.28 

0.90 

0.49 

50371 

B 

0 

13 

24 

-0.22 

0.27 

1.04 

-0.22 

50371 

C 

0 

9 

17 

-0.13 

0.24 

0.97 

-0.14 

50371 

D 

0 

7 

13 

-0.69 

0.17 

0.47 

-0.30 

50372 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50372 

A 

1 

11 

22 

0.70 

0.27 

1.64 

0.10 

50372 

B 

0 

38 

76 

0.49 

0.16 

1.25 

-0.05 

50372 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50372 

D 

0 

1 

2 

-0.47 

0.00 

0.30 

-0.15 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50373 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50373 

A 

1 

33 

63 

0.87 

0.21 

0.89 

0.48 

50373 

B 

0 

2 

4 

-0.24 

0.11 

0.67 

-0.09 

50373 

C 

0 

12 

23 

-0.34 

0.39 

1.16 

-0.30 

50373 

D 

0 

5 

10 

-0.83 

0.47 

0.53 

-0.30 

50374 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50374 

A 

1 

25 

48 

1.18 

0.24 

0.89 

0.48 

50374 

B 

0 

8 

15 

-0.08 

0.50 

1.46 

-0.20 

50374 

C 

0 

12 

23 

0.11 

0.27 

0.92 

-0.17 

50374 

D 

0 

7 

13 

-0.43 

0.43 

0.64 

-0.29 

50375 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50375 

A 

1 

26 

49 

0.76 

0.22 

1.37 

0.22 

50375 

B 

0 

12 

23 

0.49 

0.36 

1.69 

-0.01 

50375 

C 

0 

11 

21 

0.00 

0.37 

1.21 

-0.23 

50375 

D 

0 

4 

8 

0.31 

0.09 

0.83 

-0.05 

50376 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50376 

A 

1 

11 

22 

2.53 

0.45 

0.42 

0.68 

50376 

B 

0 

13 

26 

0.52 

0.24 

1.17 

-0.05 

50376 

C 

0 

23 

46 

-0.13 

0.19 

0.59 

-0.48 

50376 

D 

0 

3 

6 

0.09 

0.90 

0.86 

-0.09 

50377 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

50377 

A 

1 

25 

46 

0.81 

0.25 

1.51 

0.32 

50377 

B 

0 

4 

7 

0.37 

0.93 

3.44 

-0.01 

50377 

C 

0 

23 

43 

0.01 

0.21 

1.00 

-0.28 

50377 

D 

0 

2 

4 

-0.22 

0.10 

0.52 

-0.10 

50378 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50378 

A 

1 

26 

50 

1.07 

0.17 

0.80 

0.55 

50378 

B 

0 

20 

38 

0.08 

0.18 

0.90 

-0.32 

50378 

C 

0 

2 

4 

-1.91 

0.22 

0.09 

-0.46 

50378 

D 

0 

4 

8 

0.11 

0.16 

0.70 

-0.11 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50379 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

50379 

A 

1 

10 

19 

1.77 

0.40 

0.64 

0.59 

50379 

B 

0 

22 

41 

0.16 

0.20 

0.92 

-0.14 

50379 

C 

0 

12 

22 

-0.03 

0.24 

0.64 

-0.18 

50379 

D 

0 

10 

19 

-0.16 

0.22 

0.51 

-0.22 

50380 

* 

-1 

4716 

99 

0.91 

0.02 

0.00 

0.03 

50380 

A 

1 

21 

47 

0.82 

0.25 

1.31 

0.27 

50380 

B 

0 

3 

7 

0.17 

0.81 

1.11 

-0.11 

50380 

C 

0 

15 

33 

0.29 

0.16 

0.90 

-0.20 

50380 

D 

0 

6 

13 

0.47 

0.21 

1.04 

-0.03 

50381 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50381 

A 

1 

27 

49 

0.83 

0.20 

1.03 

0.34 

50381 

B 

0 

25 

45 

0.18 

0.19 

1.15 

-0.26 

50381 

C 

0 

2 

4 

-0.87 

0.42 

0.29 

-0.25 

50381 

D 

0 

1 

2 

0.67 

0.00 

1.24 

0.03 

50382 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50382 

A 

1 

35 

67 

0.94 

0.23 

1.01 

0.39 

50382 

B 

0 

13 

25 

0.05 

0.27 

1.30 

-0.22 

50382 

C 

0 

2 

4 

-1.36 

0.37 

0.22 

-0.28 

50382 

D 

0 

2 

4 

-0.68 

0.42 

0.44 

-0.18 

50383 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50383 

A 

1 

32 

64 

1.17 

0.22 

0.88 

0.52 

50383 

B 

0 

16 

32 

-0.12 

0.18 

0.70 

-0.41 

50383 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50383 

D 

0 

2 

4 

-1.30 

1.79 

0.55 

-0.30 

50384 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50384 

A 

1 

40 

75 

0.88 

0.16 

0.90 

0.50 

50384 

B 

0 

8 

15 

-0.32 

0.42 

0.89 

-0.33 

50384 

C 

0 

4 

8 

-0.57 

0.16 

0.44 

-0.29 

50384 

D 

0 

1 

2 

-0.79 

0.00 

0.34 

-0.17 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50385 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50385 

A 

1 

32 

65 

1.03 

0.25 

1.07 

0.50 

50385 

B 

0 

3 

6 

0.01 

0.39 

0.94 

-0.05 

50385 

C 

0 

4 

8 

-0.15 

0.60 

1.13 

-0.08 

50385 

D 

0 

10 

20 

-1.47 

0.74 

0.82 

-0.50 

50386 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50386 

A 

1 

39 

78 

0.55 

0.18 

0.90 

0.46 

50386 

B 

0 

5 

10 

-0.65 

0.41 

0.79 

-0.23 

50386 

C 

0 

3 

6 

-0.12 

0.61 

1.46 

-0.07 

50386 

D 

0 

3 

6 

-1.99 

1.15 

0.46 

-0.44 

50387 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50387 

A 

1 

43 

83 

0.60 

0.16 

0.95 

0.38 

50387 

B 

0 

1 

2 

-1.68 

0.00 

0.17 

-0.28 

50387 

C 

0 

5 

10 

-0.23 

0.33 

0.87 

-0.20 

50387 

D 

0 

3 

6 

-0.41 

0.23 

0.62 

-0.20 

50388 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50388 

A 

1 

47 

90 

0.77 

0.16 

0.91 

0.42 

50388 

B 

0 

1 

2 

-0.95 

0.00 

0.33 

-0.19 

50388 

C 

0 

1 

2 

-1.72 

0.00 

0.15 

-0.29 

50388 

D 

0 

3 

6 

-0.55 

0.45 

0.60 

-0.25 

50389 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.01 

50389 

A 

1 

48 

94 

0.89 

0.13 

0.91 

0.30 

50389 

B 

0 

1 

2 

1.30 

0.00 

2.31 

0.07 

50389 

C 

0 

2 

4 

-1.14 

0.18 

0.21 

-0.42 

50389 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50390 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50390 

A 

1 

49 

92 

0.49 

0.18 

1.00 

0.26 

50390 

B 

0 

1 

2 

0.03 

0.00 

1.16 

-0.04 

50390 

C 

0 

1 

2 

-1.38 

0.00 

0.29 

-0.20 

50390 

D 

0 

2 

4 

-0.74 

0.54 

0.62 

-0.18 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50391 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

50391 

A 

1 

44 

81 

0.69 

0.16 

0.89 

0.46 

50391 

B 

0 

2 

4 

-0.12 

0.34 

0.84 

-0.10 

50391 

C 

0 

2 

4 

-0.35 

1.03 

1.00 

-0.14 

50391 

D 

0 

6 

11 

-0.94 

0.38 

0.44 

-0.43 

50392 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50392 

A 

1 

48 

91 

0.83 

0.16 

1.06 

0.22 

50392 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50392 

C 

0 

3 

6 

-0.01 

0.69 

1.18 

-0.17 

50392 

D 

0 

2 

4 

-0.01 

0.12 

0.73 

-0.13 

50393 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.01 

50393 

A 

1 

47 

90 

0.87 

0.14 

0.82 

0.40 

50393 

B 

0 

2 

4 

0.51 

0.93 

1.83 

-0.04 

50393 

C 

0 

1 

2 

-0.36 

0.00 

0.53 

-0.13 

50393 

D 

0 

2 

4 

-2.01 

0.82 

0.14 

-0.49 

50394 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50394 

A 

1 

45 

88 

0.55 

0.17 

1.05 

0.31 

50394 

B 

0 

2 

4 

-0.24 

0.43 

0.86 

-0.12 

50394 

C 

0 

3 

6 

-0.53 

0.37 

0.67 

-0.21 

50394 

D 

0 

1 

2 

-1.04 

0.00 

0.36 

-0.18 

50395 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.02 

50395 

A 

1 

40 

75 

1.08 

0.17 

0.75 

0.59 

50395 

B 

0 

2 

4 

-0.94 

0.39 

0.31 

-0.25 

50395 

C 

0 

7 

13 

-0.58 

0.25 

0.50 

-0.39 

50395 

D 

0 

4 

8 

-0.60 

0.55 

0.59 

-0.29 

50396 

* 

-1 

4455 

94 

0.87 

0.02 

0.00 

-0.08 

50396 

A 

1 

262 

86 

1.51 

0.07 

0.92 

0.40 

50396 

B 

0 

23 

8 

0.12 

0.21 

0.73 

-0.28 

50396 

C 

0 

20 

7 

0.32 

0.15 

0.68 

-0.22 

50396 

D 

0 

1 

0 

-3.09 

0.00 

0.02 

-0.21 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50397 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50397 

A 

1 

37 

73 

0.59 

0.17 

0.88 

0.50 

50397 

B 

0 

5 

10 

-0.80 

0.58 

1.03 

-0.30 

50397 

C 

0 

5 

10 

-0.37 

0.38 

0.87 

-0.17 

50397 

D 

0 

4 

8 

-0.99 

0.12 

0.39 

-0.31 

50398 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50398 

A 

1 

41 

79 

0.74 

0.17 

0.93 

0.38 

50398 

B 

0 

7 

13 

0.05 

0.42 

1.46 

-0.17 

50398 

C 

0 

2 

4 

-0.97 

0.13 

0.32 

-0.27 

50398 

D 

0 

2 

4 

-0.78 

0.25 

0.39 

-0.23 

50399 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50399 

A 

1 

47 

96 

0.44 

0.15 

1.01 

0.59 

50399 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50399 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50399 

D 

0 

2 

4 

-3.73 

2.66 

0.39 

-0.59 

50400 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50400 

A 

1 

33 

63 

0.79 

0.19 

0.95 

0.47 

50400 

B 

0 

3 

6 

-0.48 

0.10 

0.52 

-0.18 

50400 

C 

0 

12 

23 

-0.03 

0.33 

1.26 

-0.19 

50400 

D 

0 

4 

8 

-1.24 

0.21 

0.26 

-0.39 

50401 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50401 

A 

1 

43 

80 

0.70 

0.20 

1.11 

0.21 

50401 

B 

0 

9 

17 

0.25 

0.25 

1.35 

-0.11 

50401 

C 

0 

2 

4 

-0.99 

1.13 

0.53 

-0.24 

50401 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50402 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50402 

A 

1 

44 

90 

0.39 

0.19 

1.23 

0.02 

50402 

B 

0 

2 

4 

0.73 

0.12 

2.51 

0.06 

50402 

C 

0 

1 

2 

2.06 

0.00 

9.42 

0.19 

50402 

D 

0 

2 

4 

-0.95 

0.76 

0.60 

-0.22 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50403 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50403 

A 

1 

19 

38 

0.85 

0.29 

1.05 

0.40 

50403 

B 

0 

10 

20 

-0.05 

0.26 

0.92 

-0.15 

50403 

C 

0 

16 

32 

-0.22 

0.25 

1.18 

-0.31 

50403 

D 

0 

5 

10 

0.40 

0.23 

1.24 

0.03 

50404 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50404 

A 

1 

37 

76 

0.79 

0.20 

1.16 

0.23 

50404 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50404 

C 

0 

11 

22 

-0.12 

0.27 

0.90 

-0.33 

50404 

D 

0 

1 

2 

2.88 

0.00 

13.01 

0.27 

50405 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50405 

A 

1 

33 

66 

0.86 

0.19 

1.10 

0.42 

50405 

B 

0 

3 

6 

-0.58 

0.39 

0.45 

-0.18 

50405 

C 

0 

11 

22 

0.23 

0.19 

0.99 

-0.07 

50405 

D 

0 

3 

6 

-2.64 

1.90 

0.36 

-0.54 

50406 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.07 

50406 

A 

1 

44 

88 

0.15 

0.17 

1.11 

0.27 

50406 

B 

0 

1 

2 

-1.72 

0.00 

0.26 

-0.22 

50406 

C 

0 

3 

6 

-0.02 

0.41 

1.74 

-0.01 

50406 

D 

0 

2 

4 

-1.55 

0.25 

0.33 

-0.28 

50407 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.01 

50407 

A 

1 

35 

69 

1.16 

0.20 

0.93 

0.43 

50407 

B 

0 

12 

24 

-0.26 

0.42 

1.39 

-0.42 

50407 

C 

0 

1 

2 

-1.19 

0.00 

0.19 

-0.20 

50407 

D 

0 

3 

6 

0.94 

0.54 

2.18 

0.03 

50408 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

50408 

A 

1 

28 

56 

1.36 

0.20 

0.74 

0.61 

50408 

B 

0 

7 

14 

0.40 

0.31 

1.18 

-0.11 

50408 

C 

0 

13 

26 

-0.42 

0.18 

0.45 

-0.57 

50408 

D 

0 

2 

4 

0.34 

0.20 

0.80 

-0.07 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50409 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50409 

A 

1 

28 

57 

1.17 

0.28 

1.10 

0.44 

50409 

B 

0 

11 

22 

0.20 

0.28 

1.21 

-0.17 

50409 

C 

0 

5 

10 

0.22 

0.22 

0.93 

-0.10 

50409 

D 

0 

5 

10 

-0.95 

0.23 

0.29 

-0.39 

50410 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50410 

A 

1 

25 

48 

0.96 

0.22 

1.45 

0.35 

50410 

B 

0 

11 

21 

0.51 

0.19 

1.02 

-0.05 

50410 

C 

0 

10 

19 

0.20 

0.29 

0.87 

-0.20 

50410 

D 

0 

6 

12 

-0.05 

0.31 

0.61 

-0.24 

50411 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.01 

50411 

A 

1 

30 

63 

0.89 

0.24 

1.48 

0.09 

50411 

B 

0 

6 

13 

0.36 

0.81 

3.11 

-0.13 

50411 

C 

0 

8 

17 

0.45 

0.30 

1.18 

-0.12 

50411 

D 

0 

4 

8 

1.49 

0.08 

2.50 

0.16 

50412 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.04 

50412 

A 

1 

26 

46 

0.86 

0.26 

1.20 

0.34 

50412 

B 

0 

11 

19 

0.54 

0.30 

1.69 

0.05 

50412 

C 

0 

15 

26 

-0.35 

0.18 

0.57 

-0.39 

50412 

D 

0 

5 

9 

0.25 

0.43 

1.18 

-0.05 

50413 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50413 

A 

1 

23 

46 

1.05 

0.31 

1.22 

0.42 

50413 

B 

0 

11 

22 

0.20 

0.28 

1.19 

-0.11 

50413 

C 

0 

11 

22 

-0.26 

0.22 

0.61 

-0.31 

50413 

D 

0 

5 

10 

0.03 

0.47 

0.99 

-0.12 

50414 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50414 

A 

1 

48 

96 

0.58 

0.16 

0.65 

0.46 

50414 

B 

0 

1 

2 

-0.42 

0.00 

1.01 

-0.09 

50414 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50414 

D 

0 

1 

2 

-4.60 

0.00 

0.02 

-0.54 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50415 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50415 

A 

1 

50 

96 

0.40 

0.16 

1.03 

0.43 

50415 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50415 

C 

0 

1 

2 

0.65 

0.00 

2.12 

0.04 

50415 

D 

0 

1 

2 

-6.39 

0.00 

0.00 

-0.64 

50416 

* 

-1 

4464 

94 

0.87 

0.02 

0.00 

-0.08 

50416 

A 

1 

222 

75 

1.58 

0.08 

0.96 

0.38 

50416 

B 

0 

64 

22 

0.68 

0.11 

0.98 

-0.28 

50416 

C 

0 

4 

1 

0.99 

0.17 

0.99 

-0.03 

50416 

D 

0 

7 

2 

-1.05 

0.47 

0.22 

-0.30 

50417 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

50417 

A 

1 

46 

84 

0.70 

0.20 

1.21 

0.12 

50417 

B 

0 

1 

2 

0.28 

0.00 

1.12 

-0.04 

50417 

C 

0 

5 

9 

0.81 

0.30 

2.18 

0.04 

50417 

D 

0 

3 

5 

-0.64 

0.57 

0.63 

-0.23 

50418 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50418 

A 

1 

35 

71 

0.59 

0.22 

2.13 

0.09 

50418 

B 

0 

3 

6 

0.08 

0.60 

1.07 

-0.10 

50418 

C 

0 

4 

8 

0.56 

0.49 

1.70 

0.01 

50418 

D 

0 

7 

14 

0.39 

0.17 

1.18 

-0.05 

50419 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50419 

A 

1 

38 

78 

0.63 

0.15 

1.09 

0.19 

50419 

B 

0 

2 

4 

-0.04 

0.68 

0.84 

-0.14 

50419 

C 

0 

5 

10 

0.28 

0.22 

1.03 

-0.10 

50419 

D 

0 

4 

8 

0.31 

0.43 

1.26 

-0.08 

50420 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50420 

A 

-1 

49 

100 

0.61 

0.18 

0.00 

0.00 

50420 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50420 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50420 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50421 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

50421 

A 

1 

32 

64 

0.95 

0.23 

1.18 

0.25 

50421 

B 

0 

5 

10 

0.00 

0.16 

0.66 

-0.18 

50421 

C 

0 

2 

4 

-0.71 

1.06 

0.50 

-0.23 

50421 

D 

0 

11 

22 

0.59 

0.40 

2.56 

-0.05 

50422 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50422 

A 

1 

39 

76 

0.61 

0.19 

1.06 

0.35 

50422 

B 

0 

1 

2 

-0.55 

0.00 

0.54 

-0.11 

50422 

C 

0 

2 

4 

-0.97 

0.09 

0.36 

-0.24 

50422 

D 

0 

9 

18 

-0.18 

0.27 

0.99 

-0.23 

50423 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.03 

50423 

A 

1 

35 

74 

0.72 

0.21 

1.05 

0.27 

50423 

B 

0 

2 

4 

-0.26 

0.65 

0.79 

-0.14 

50423 

C 

0 

1 

2 

-0.67 

0.00 

0.43 

-0.15 

50423 

D 

0 

9 

19 

0.10 

0.30 

1.30 

-0.17 

50424 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50424 

A 

1 

39 

78 

0.78 

0.22 

1.14 

0.38 

50424 

B 

0 

2 

4 

-0.83 

0.16 

0.42 

-0.20 

50424 

C 

0 

1 

2 

-0.90 

0.00 

0.38 

-0.15 

50424 

D 

0 

8 

16 

-0.34 

0.43 

1.13 

-0.27 

50425 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

0.01 

50425 

A 

1 

38 

60 

1.43 

0.17 

0.84 

0.59 

50425 

B 

0 

3 

5 

-0.61 

0.40 

0.31 

-0.26 

50425 

C 

0 

15 

24 

0.09 

0.22 

0.72 

-0.34 

50425 

D 

0 

7 

11 

-0.17 

0.49 

0.68 

-0.29 

50426 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.05 

50426 

A 

1 

31 

54 

0.52 

0.20 

1.44 

0.21 

50426 

B 

0 

5 

9 

0.96 

0.28 

2.35 

0.18 

50426 

C 

0 

9 

16 

0.17 

0.23 

1.08 

-0.05 

50426 

D 

0 

12 

21 

-0.43 

0.40 

1.22 

-0.33 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50427 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

-0.01 

50427 

A 

1 

22 

45 

1.65 

0.23 

0.74 

0.54 

50427 

B 

0 

17 

35 

0.53 

0.24 

1.02 

-0.29 

50427 

C 

0 

2 

4 

-0.11 

0.38 

0.38 

-0.20 

50427 

D 

0 

8 

16 

0.34 

0.19 

0.63 

-0.25 

50428 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50428 

A 

1 

33 

62 

1.04 

0.17 

0.75 

0.62 

50428 

B 

0 

12 

23 

-0.50 

0.24 

0.60 

-0.44 

50428 

C 

0 

2 

4 

-1.60 

0.81 

0.20 

-0.34 

50428 

D 

0 

6 

11 

-0.05 

0.36 

0.94 

-0.15 

50429 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

50429 

A 

1 

23 

46 

1.38 

0.29 

0.88 

0.54 

50429 

B 

0 

16 

32 

-0.02 

0.18 

0.74 

-0.31 

50429 

C 

0 

4 

8 

0.42 

0.86 

2.57 

-0.04 

50429 

D 

0 

7 

14 

-0.57 

0.22 

0.42 

-0.34 

50430 

* 

-1 

4695 

99 

0.90 

0.02 

0.00 

0.02 

50430 

A 

1 

34 

52 

1.27 

0.17 

0.89 

0.47 

50430 

B 

0 

21 

32 

0.32 

0.23 

1.10 

-0.22 

50430 

C 

0 

3 

5 

0.26 

0.61 

0.92 

-0.08 

50430 

D 

0 

8 

12 

-0.51 

0.51 

0.74 

-0.37 

50431 

* 

-1 

4466 

94 

0.86 

0.02 

0.00 

-0.11 

50431 

A 

1 

229 

78 

1.82 

0.07 

0.85 

0.50 

50431 

B 

0 

47 

16 

0.22 

0.14 

0.60 

-0.44 

50431 

C 

0 

14 

5 

0.78 

0.17 

0.83 

-0.13 

50431 

D 

0 

5 

2 

-0.31 

0.82 

0.67 

-0.19 

50432 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50432 

A 

1 

29 

57 

0.70 

0.30 

2.59 

0.25 

50432 

B 

0 

13 

25 

0.18 

0.22 

1.29 

-0.10 

50432 

C 

0 

4 

8 

-0.12 

0.43 

0.93 

-0.11 

50432 

D 

0 

5 

10 

-0.28 

0.59 

1.16 

-0.16 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50433 

* 

-1 

4715 

99 

0.91 

0.02 

0.00 

0.06 

50433 

A 

1 

43 

93 

0.13 

0.17 

1.11 

0.11 

50433 

B 

0 

1 

2 

-0.46 

0.00 

0.91 

-0.08 

50433 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50433 

D 

0 

2 

4 

-0.26 

0.64 

1.34 

-0.07 

50434 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

50434 

A 

1 

51 

94 

0.40 

0.16 

1.06 

0.09 

50434 

B 

0 

1 

2 

-0.07 

0.00 

1.01 

-0.06 

50434 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50434 

D 

0 

2 

4 

-0.03 

0.67 

1.29 

-0.07 

50435 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.04 

50435 

A 

1 

39 

68 

0.71 

0.19 

1.31 

0.32 

50435 

B 

0 

2 

4 

-0.01 

1.43 

1.84 

-0.07 

50435 

C 

0 

12 

21 

-0.13 

0.38 

1.82 

-0.23 

50435 

D 

0 

4 

7 

-0.34 

0.53 

0.86 

-0.17 

50436 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50436 

A 

1 

43 

83 

0.57 

0.18 

1.25 

0.07 

50436 

B 

0 

4 

8 

0.21 

0.39 

1.26 

-0.09 

50436 

C 

0 

3 

6 

0.30 

0.27 

1.21 

-0.05 

50436 

D 

0 

2 

4 

0.77 

0.97 

2.70 

0.04 

50437 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.05 

50437 

A 

1 

46 

85 

0.45 

0.14 

0.84 

0.48 

50437 

B 

0 

3 

6 

-1.40 

0.74 

0.43 

-0.36 

50437 

C 

0 

4 

7 

-0.70 

0.58 

0.80 

-0.24 

50437 

D 

0 

1 

2 

-1.30 

0.00 

0.31 

-0.19 

50438 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.02 

50438 

A 

1 

40 

70 

1.04 

0.22 

1.38 

0.38 

50438 

B 

0 

9 

16 

-0.07 

0.41 

1.12 

-0.25 

50438 

C 

0 

4 

7 

-0.04 

0.32 

0.78 

-0.15 

50438 

D 

0 

4 

7 

-0.11 

0.39 

0.74 

-0.17 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50439 

* 

-1 

4702 

99 

0.90 

0.02 

0.00 

0.01 

50439 

A 

1 

19 

32 

0.99 

0.24 

1.62 

0.11 

50439 

B 

0 

18 

31 

1.24 

0.31 

2.82 

0.22 

50439 

C 

0 

3 

5 

-0.05 

0.75 

0.61 

-0.12 

50439 

D 

0 

19 

32 

0.14 

0.45 

1.08 

-0.27 

50440 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.03 

50440 

A 

1 

15 

25 

0.88 

0.33 

1.92 

0.14 

50440 

B 

0 

20 

33 

0.50 

0.30 

1.47 

-0.06 

50440 

C 

0 

2 

3 

-0.08 

0.37 

0.41 

-0.11 

50440 

D 

0 

23 

38 

0.56 

0.21 

1.04 

-0.03 

50441 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.02 

50441 

A 

1 

11 

19 

1.30 

0.45 

1.85 

0.24 

50441 

B 

0 

11 

19 

0.51 

0.24 

0.74 

-0.06 

50441 

C 

0 

18 

31 

1.04 

0.24 

1.43 

0.19 

50441 

D 

0 

18 

31 

0.04 

0.33 

0.80 

-0.34 

50442 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.02 

50442 

A 

1 

10 

19 

1.31 

0.46 

1.58 

0.29 

50442 

B 

0 

16 

30 

0.31 

0.27 

0.82 

-0.16 

50442 

C 

0 

14 

26 

0.81 

0.31 

1.47 

0.11 

50442 

D 

0 

14 

26 

0.23 

0.25 

0.66 

-0.19 

50443 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50443 

A 

1 

12 

22 

0.64 

0.39 

2.33 

0.07 

50443 

B 

0 

9 

17 

0.41 

0.57 

2.51 

-0.02 

50443 

C 

0 

17 

31 

0.58 

0.25 

1.36 

0.05 

50443 

D 

0 

16 

30 

0.30 

0.32 

1.85 

-0.09 

50444 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50444 

A 

1 

14 

29 

0.57 

0.25 

1.18 

0.22 

50444 

B 

0 

7 

15 

0.00 

0.27 

0.80 

-0.09 

50444 

C 

0 

13 

27 

0.14 

0.23 

1.17 

-0.05 

50444 

D 

0 

14 

29 

0.05 

0.36 

1.22 

-0.11 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50445 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.03 

50445 

A 

1 

32 

54 

0.78 

0.19 

1.15 

0.30 

50445 

B 

0 

13 

22 

0.32 

0.25 

1.37 

-0.09 

50445 

C 

0 

9 

15 

-0.04 

0.31 

0.86 

-0.23 

50445 

D 

0 

5 

8 

0.20 

0.35 

0.93 

-0.09 

50446 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50446 

A 

1 

27 

49 

0.99 

0.27 

1.23 

0.37 

50446 

B 

0 

8 

15 

0.57 

0.23 

1.39 

0.01 

50446 

C 

0 

14 

25 

-0.04 

0.22 

0.92 

-0.28 

50446 

D 

0 

6 

11 

-0.23 

0.28 

0.61 

-0.22 

50447 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.04 

50447 

A 

1 

22 

37 

0.61 

0.25 

1.77 

0.16 

50447 

B 

0 

15 

25 

0.02 

0.27 

0.92 

-0.17 

50447 

C 

0 

15 

25 

0.85 

0.25 

2.30 

0.23 

50447 

D 

0 

7 

12 

-0.71 

0.60 

0.71 

-0.33 

50448 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.06 

50448 

A 

1 

33 

63 

0.44 

0.15 

0.94 

0.42 

50448 

B 

0 

14 

27 

-0.59 

0.28 

0.75 

-0.45 

50448 

C 

0 

3 

6 

-0.14 

0.47 

1.04 

-0.07 

50448 

D 

0 

2 

4 

0.45 

0.38 

1.60 

0.07 

50449 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.02 

50449 

A 

1 

28 

47 

1.18 

0.22 

1.09 

0.43 

50449 

B 

0 

19 

32 

0.46 

0.25 

1.40 

-0.10 

50449 

C 

0 

4 

7 

-0.29 

0.27 

0.43 

-0.20 

50449 

D 

0 

8 

14 

-0.44 

0.33 

0.45 

-0.35 

50450 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

50450 

A 

1 

26 

48 

0.97 

0.19 

0.82 

0.56 

50450 

B 

0 

12 

22 

0.02 

0.22 

0.92 

-0.18 

50450 

C 

0 

9 

17 

-0.54 

0.29 

0.57 

-0.39 

50450 

D 

0 

7 

13 

-0.13 

0.26 

0.70 

-0.18 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50451 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50451 

A 

1 

44 

88 

0.50 

0.16 

0.89 

0.43 

50451 

B 

0 

4 

8 

-1.10 

0.46 

0.50 

-0.37 

50451 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50451 

D 

0 

2 

4 

-0.85 

0.41 

0.51 

-0.21 

50452 

* 

-1 

4702 

99 

0.90 

0.02 

0.00 

0.01 

50452 

A 

1 

57 

97 

0.79 

0.15 

1.03 

0.10 

50452 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50452 

C 

0 

2 

3 

0.18 

0.15 

0.89 

-0.10 

50452 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50453 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.04 

50453 

A 

1 

44 

77 

0.71 

0.17 

0.86 

0.42 

50453 

B 

0 

11 

19 

-0.40 

0.34 

1.01 

-0.34 

50453 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50453 

D 

0 

2 

4 

-0.99 

0.32 

0.35 

-0.23 

50454 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.04 

50454 

A 

1 

53 

93 

0.51 

0.18 

1.02 

0.16 

50454 

B 

0 

2 

4 

-1.42 

0.94 

0.44 

-0.26 

50454 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50454 

D 

0 

2 

4 

0.78 

0.19 

2.74 

0.05 

50455 

* 

-1 

4702 

99 

0.90 

0.02 

0.00 

0.02 

50455 

A 

1 

53 

90 

0.77 

0.16 

1.04 

0.24 

50455 

B 

0 

2 

3 

-0.20 

0.49 

0.73 

-0.15 

50455 

C 

0 

4 

7 

-0.10 

0.56 

1.18 

-0.19 

50455 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50456 

* 

-1 

4700 

99 

0.90 

0.02 

0.00 

0.00 

50456 

A 

1 

48 

79 

1.10 

0.19 

1.02 

0.33 

50456 

B 

0 

1 

2 

-0.89 

0.00 

0.28 

-0.17 

50456 

C 

0 

5 

8 

0.27 

0.57 

1.44 

-0.13 

50456 

D 

0 

7 

11 

-0.04 

0.28 

0.82 

-0.24 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50457 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

50457 

A 

1 

47 

89 

0.44 

0.17 

0.82 

0.38 

50457 

B 

0 

6 

11 

-1.21 

0.78 

2.31 

-0.38 

50457 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50457 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50458 

* 

-1 

4699 

99 

0.90 

0.02 

0.00 

0.00 

50458 

A 

1 

59 

95 

1.01 

0.15 

0.82 

0.40 

50458 

B 

0 

2 

3 

-0.82 

0.99 

0.54 

-0.25 

50458 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50458 

D 

0 

1 

2 

-2.41 

0.00 

0.07 

-0.33 

50459 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50459 

A 

1 

42 

86 

0.60 

0.16 

1.15 

0.03 

50459 

B 

0 

3 

6 

0.90 

0.13 

1.87 

0.08 

50459 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50459 

D 

0 

4 

8 

0.23 

0.39 

1.13 

-0.11 

50460 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.03 

50460 

A 

1 

46 

77 

0.68 

0.17 

1.25 

0.15 

50460 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50460 

C 

0 

7 

12 

0.85 

0.23 

2.02 

0.09 

50460 

D 

0 

7 

12 

-0.26 

0.28 

0.66 

-0.28 

50461 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.02 

50461 

A 

1 

41 

71 

0.88 

0.16 

1.13 

0.30 

50461 

B 

0 

16 

28 

0.23 

0.20 

1.07 

-0.28 

50461 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50461 

D 

0 

1 

2 

0.05 

0.00 

0.64 

-0.08 

50462 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.04 

50462 

A 

1 

38 

69 

0.81 

0.13 

0.78 

0.50 

50462 

B 

0 

13 

24 

-0.27 

0.40 

1.38 

-0.35 

50462 

C 

0 

3 

5 

-0.72 

0.74 

0.64 

-0.25 

50462 

D 

0 

1 

2 

-1.20 

0.00 

0.23 

-0.20 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50463 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50463 

A 

1 

35 

71 

0.23 

0.16 

1.16 

0.28 

50463 

B 

0 

4 

8 

-0.57 

0.35 

0.77 

-0.19 

50463 

C 

0 

7 

14 

-0.66 

0.30 

0.80 

-0.29 

50463 

D 

0 

3 

6 

0.51 

0.79 

2.92 

0.12 

50464 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50464 

A 

1 

37 

73 

0.69 

0.20 

1.26 

0.26 

50464 

B 

0 

4 

8 

0.05 

0.52 

1.13 

-0.12 

50464 

C 

0 

4 

8 

0.03 

0.38 

1.01 

-0.12 

50464 

D 

0 

6 

12 

-0.01 

0.43 

1.10 

-0.16 

50465 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50465 

A 

1 

47 

89 

1.00 

0.18 

0.98 

0.36 

50465 

B 

0 

5 

9 

-0.33 

0.30 

0.62 

-0.30 

50465 

C 

0 

1 

2 

-0.99 

0.00 

0.27 

-0.20 

50465 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50466 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.03 

50466 

A 

1 

45 

78 

0.85 

0.15 

0.84 

0.52 

50466 

B 

0 

4 

7 

-0.63 

0.63 

0.81 

-0.28 

50466 

C 

0 

3 

5 

-0.61 

0.23 

0.46 

-0.23 

50466 

D 

0 

6 

10 

-0.51 

0.30 

0.61 

-0.31 

50467 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.05 

50467 

A 

1 

32 

55 

0.78 

0.21 

1.46 

0.41 

50467 

B 

0 

22 

38 

-0.26 

0.23 

1.29 

-0.35 

50467 

C 

0 

2 

3 

0.74 

0.91 

2.41 

0.06 

50467 

D 

0 

2 

3 

-1.34 

0.35 

0.22 

-0.25 

50468 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50468 

A 

1 

22 

45 

0.83 

0.27 

1.41 

0.29 

50468 

B 

0 

7 

14 

0.40 

0.28 

1.19 

-0.03 

50468 

C 

0 

8 

16 

0.46 

0.43 

2.33 

-0.01 

50468 

D 

0 

12 

24 

-0.09 

0.17 

0.68 

-0.30 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50469 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50469 

A 

1 

19 

37 

0.67 

0.26 

1.40 

0.17 

50469 

B 

0 

9 

17 

0.11 

0.10 

0.66 

-0.10 

50469 

C 

0 

19 

37 

0.37 

0.31 

1.49 

-0.01 

50469 

D 

0 

5 

10 

-0.15 

1.12 

1.23 

-0.14 

50470 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50470 

A 

1 

18 

33 

1.32 

0.26 

0.95 

0.45 

50470 

B 

0 

10 

18 

-0.10 

0.17 

0.47 

-0.28 

50470 

C 

0 

22 

40 

0.26 

0.23 

1.12 

-0.23 

50470 

D 

0 

5 

9 

0.71 

0.68 

1.91 

0.03 

50471 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50471 

A 

1 

28 

55 

1.06 

0.19 

0.88 

0.52 

50471 

B 

0 

7 

14 

0.23 

0.45 

1.67 

-0.08 

50471 

C 

0 

3 

6 

-0.01 

0.66 

0.89 

-0.10 

50471 

D 

0 

13 

25 

-0.50 

0.29 

0.58 

-0.47 

50472 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50472 

A 

1 

28 

54 

0.95 

0.19 

0.92 

0.43 

50472 

B 

0 

13 

25 

0.03 

0.32 

1.32 

-0.22 

50472 

C 

0 

4 

8 

0.39 

0.47 

1.39 

-0.02 

50472 

D 

0 

7 

13 

-0.49 

0.51 

0.77 

-0.33 

50473 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.04 

50473 

A 

1 

22 

37 

1.34 

0.22 

0.80 

0.54 

50473 

B 

0 

18 

30 

0.24 

0.23 

1.05 

-0.12 

50473 

C 

0 

6 

10 

0.48 

0.44 

1.46 

0.01 

50473 

D 

0 

14 

23 

-0.66 

0.29 

0.46 

-0.49 

50474 

* 

-1 

4700 

99 

0.91 

0.02 

0.00 

0.03 

50474 

A 

1 

44 

72 

0.96 

0.20 

1.03 

0.45 

50474 

B 

0 

9 

15 

0.07 

0.22 

1.04 

-0.16 

50474 

C 

0 

2 

3 

-0.74 

0.05 

0.39 

-0.18 

50474 

D 

0 

6 

10 

-0.99 

0.35 

0.40 

-0.38 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50475 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50475 

A 

1 

41 

75 

0.88 

0.15 

0.84 

0.55 

50475 

B 

0 

6 

11 

-0.98 

0.25 

0.32 

-0.50 

50475 

C 

0 

5 

9 

-0.17 

0.32 

0.79 

-0.21 

50475 

D 

0 

3 

5 

0.03 

0.41 

0.89 

-0.11 

50476 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50476 

A 

1 

31 

60 

1.09 

0.21 

0.84 

0.54 

50476 

B 

0 

15 

29 

-0.16 

0.21 

0.85 

-0.34 

50476 

C 

0 

1 

2 

-1.04 

0.00 

0.26 

-0.17 

50476 

D 

0 

5 

10 

-0.68 

0.66 

0.97 

-0.31 

50477 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

50477 

A 

1 

47 

85 

0.92 

0.14 

0.73 

0.58 

50477 

B 

0 

5 

9 

-1.15 

0.34 

0.30 

-0.50 

50477 

C 

0 

2 

4 

-0.69 

0.95 

0.57 

-0.23 

50477 

D 

0 

1 

2 

-0.40 

0.00 

0.52 

-0.13 

50478 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.01 

50478 

A 

1 

36 

67 

1.21 

0.21 

1.01 

0.44 

50478 

B 

0 

7 

13 

0.06 

0.25 

0.72 

-0.26 

50478 

C 

0 

8 

15 

0.17 

0.17 

0.72 

-0.24 

50478 

D 

0 

3 

6 

0.02 

0.46 

0.67 

-0.17 

50479 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50479 

A 

1 

25 

50 

1.32 

0.27 

1.45 

0.54 

50479 

B 

0 

5 

10 

0.38 

0.29 

0.95 

-0.08 

50479 

C 

0 

9 

18 

-0.10 

0.17 

0.57 

-0.30 

50479 

D 

0 

11 

22 

-0.04 

0.15 

0.60 

-0.32 

50480 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50480 

A 

1 

26 

50 

0.98 

0.20 

1.10 

0.45 

50480 

B 

0 

9 

17 

-0.16 

0.27 

0.68 

-0.27 

50480 

C 

0 

5 

10 

0.72 

0.50 

2.20 

0.07 

50480 

D 

0 

12 

23 

-0.20 

0.27 

0.67 

-0.34 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50481 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50481 

A 

1 

40 

82 

0.54 

0.16 

0.88 

0.45 

50481 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50481 

C 

0 

6 

12 

-0.47 

0.24 

0.70 

-0.28 

50481 

D 

0 

3 

6 

-1.09 

0.71 

0.52 

-0.34 

50482 

* 

-1 

4700 

99 

0.91 

0.02 

0.00 

0.03 

50482 

A 

1 

55 

90 

0.74 

0.18 

0.91 

0.40 

50482 

B 

0 

2 

3 

-1.31 

0.39 

0.33 

-0.24 

50482 

C 

0 

1 

2 

1.06 

0.00 

3.28 

0.05 

50482 

D 

0 

3 

5 

-1.76 

0.03 

0.20 

-0.37 

50483 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.05 

50483 

A 

1 

55 

92 

0.46 

0.17 

0.96 

0.40 

50483 

B 

0 

1 

2 

-1.56 

0.00 

0.30 

-0.18 

50483 

C 

0 

2 

3 

-1.66 

0.75 

0.35 

-0.27 

50483 

D 

0 

2 

3 

-1.30 

0.46 

0.43 

-0.22 

50484 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.02 

50484 

A 

1 

42 

88 

0.86 

0.16 

0.71 

0.56 

50484 

B 

0 

3 

6 

-0.50 

0.50 

0.73 

-0.22 

50484 

C 

0 

1 

2 

-1.76 

0.00 

0.16 

-0.27 

50484 

D 

0 

2 

4 

-2.31 

1.09 

0.15 

-0.47 

50485 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

50485 

A 

1 

48 

86 

0.73 

0.17 

0.89 

0.29 

50485 

B 

0 

2 

4 

-0.85 

0.71 

0.48 

-0.21 

50485 

C 

0 

4 

7 

0.37 

0.99 

4.73 

-0.04 

50485 

D 

0 

2 

4 

-1.18 

0.63 

0.33 

-0.26 

50486 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.02 

50486 

A 

1 

42 

78 

1.01 

0.20 

0.87 

0.50 

50486 

B 

0 

4 

7 

0.01 

0.16 

0.86 

-0.12 

50486 

C 

0 

6 

11 

-0.63 

0.43 

0.65 

-0.31 

50486 

D 

0 

2 

4 

-2.54 

1.33 

0.13 

-0.43 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50487 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50487 

A 

1 

47 

94 

0.55 

0.18 

0.95 

0.26 

50487 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50487 

C 

0 

3 

6 

-0.84 

0.72 

0.70 

-0.26 

50487 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50488 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50488 

A 

1 

46 

94 

0.68 

0.15 

1.09 

0.23 

50488 

B 

0 

1 

2 

-0.35 

0.00 

0.59 

-0.13 

50488 

C 

0 

2 

4 

-0.32 

0.38 

0.65 

-0.19 

50488 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50489 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50489 

A 

1 

48 

98 

0.47 

0.19 

1.01 

0.19 

50489 

B 

0 

1 

2 

-1.26 

0.00 

0.37 

-0.19 

50489 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50489 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50490 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.02 

50490 

A 

1 

44 

85 

0.83 

0.14 

0.91 

0.43 

50490 

B 

0 

3 

6 

-0.13 

0.17 

0.65 

-0.19 

50490 

C 

0 

3 

6 

-0.76 

0.33 

0.38 

-0.35 

50490 

D 

0 

2 

4 

-0.12 

0.32 

0.67 

-0.15 

50491 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50491 

A 

1 

26 

52 

0.92 

0.23 

0.89 

0.49 

50491 

B 

0 

8 

16 

-0.04 

0.32 

0.98 

-0.17 

50491 

C 

0 

11 

22 

-0.10 

0.16 

0.76 

-0.24 

50491 

D 

0 

5 

10 

-0.55 

0.43 

0.55 

-0.28 

50492 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50492 

A 

1 

33 

67 

0.84 

0.20 

1.25 

0.31 

50492 

B 

0 

6 

12 

-0.08 

0.43 

0.86 

-0.21 

50492 

C 

0 

4 

8 

0.56 

0.65 

1.82 

-0.01 

50492 

D 

0 

6 

12 

-0.14 

0.46 

0.97 

-0.23 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50493 

* 

-1 

4715 

99 

0.91 

0.02 

0.00 

0.03 

50493 

A 

1 

32 

70 

0.91 

0.19 

0.97 

0.48 

50493 

B 

0 

8 

17 

-0.31 

0.35 

0.82 

-0.34 

50493 

C 

0 

3 

7 

0.14 

0.33 

0.95 

-0.09 

50493 

D 

0 

3 

7 

-0.70 

0.50 

0.44 

-0.29 

50494 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50494 

A 

1 

26 

53 

0.68 

0.24 

0.96 

0.49 

50494 

B 

0 

7 

14 

-0.05 

0.34 

1.50 

-0.07 

50494 

C 

0 

10 

20 

-0.74 

0.25 

0.59 

-0.38 

50494 

D 

0 

6 

12 

-0.48 

0.28 

0.71 

-0.20 

50495 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

50495 

A 

1 

46 

84 

0.88 

0.19 

0.86 

0.46 

50495 

B 

0 

4 

7 

-1.08 

0.36 

0.37 

-0.33 

50495 

C 

0 

3 

5 

0.06 

0.22 

1.03 

-0.09 

50495 

D 

0 

2 

4 

-1.82 

1.57 

0.38 

-0.33 

50496 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50496 

A 

1 

46 

84 

0.73 

0.21 

1.07 

0.30 

50496 

B 

0 

3 

5 

-0.43 

0.21 

0.63 

-0.18 

50496 

C 

0 

3 

5 

-0.60 

0.59 

0.73 

-0.21 

50496 

D 

0 

3 

5 

-0.02 

0.13 

0.93 

-0.10 

50497 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

50497 

A 

1 

35 

66 

0.76 

0.19 

0.86 

0.52 

50497 

B 

0 

12 

23 

-0.34 

0.30 

1.03 

-0.28 

50497 

C 

0 

2 

4 

-1.52 

0.26 

0.21 

-0.29 

50497 

D 

0 

4 

8 

-0.93 

0.13 

0.38 

-0.28 

50498 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.03 

50498 

A 

1 

47 

81 

0.82 

0.15 

0.85 

0.47 

50498 

B 

0 

5 

9 

-0.09 

0.45 

1.22 

-0.18 

50498 

C 

0 

3 

5 

-0.82 

0.50 

0.46 

-0.29 

50498 

D 

0 

3 

5 

-0.96 

0.08 

0.31 

-0.32 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50499 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.02 

50499 

A 

1 

35 

58 

1.13 

0.22 

1.06 

0.40 

50499 

B 

0 

12 

20 

-0.35 

0.20 

0.57 

-0.39 

50499 

C 

0 

7 

12 

1.07 

0.52 

3.95 

0.11 

50499 

D 

0 

6 

10 

-0.34 

0.23 

0.51 

-0.26 

50500 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.01 

50500 

A 

1 

46 

81 

1.04 

0.14 

0.83 

0.47 

50500 

B 

0 

4 

7 

0.06 

0.85 

1.51 

-0.18 

50500 

C 

0 

3 

5 

0.14 

0.13 

0.72 

-0.14 

50500 

D 

0 

4 

7 

-0.85 

0.34 

0.31 

-0.41 

50501 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.01 

50501 

A 

1 

29 

53 

1.34 

0.23 

0.85 

0.48 

50501 

B 

0 

10 

18 

0.02 

0.40 

1.13 

-0.25 

50501 

C 

0 

13 

24 

0.21 

0.31 

1.18 

-0.22 

50501 

D 

0 

3 

5 

-0.43 

0.40 

0.40 

-0.21 

50502 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50502 

A 

1 

30 

60 

0.87 

0.21 

1.45 

0.37 

50502 

B 

0 

3 

6 

0.93 

0.08 

1.66 

0.09 

50502 

C 

0 

7 

14 

-0.02 

0.48 

1.14 

-0.18 

50502 

D 

0 

10 

20 

-0.34 

0.32 

0.67 

-0.36 

50503 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50503 

A 

1 

23 

44 

1.09 

0.24 

1.04 

0.38 

50503 

B 

0 

11 

21 

0.64 

0.38 

1.69 

0.02 

50503 

C 

0 

10 

19 

-0.01 

0.24 

0.67 

-0.27 

50503 

D 

0 

8 

15 

-0.07 

0.20 

0.59 

-0.25 

50504 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.02 

50504 

A 

1 

19 

36 

1.77 

0.29 

0.77 

0.64 

50504 

B 

0 

17 

32 

0.12 

0.20 

0.80 

-0.32 

50504 

C 

0 

9 

17 

-0.16 

0.22 

0.51 

-0.31 

50504 

D 

0 

8 

15 

0.38 

0.32 

0.95 

-0.11 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50505 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

50505 

A 

1 

15 

28 

1.12 

0.33 

1.29 

0.44 

50505 

B 

0 

5 

9 

0.13 

0.43 

1.06 

-0.04 

50505 

C 

0 

25 

47 

0.04 

0.19 

1.11 

-0.18 

50505 

D 

0 

8 

15 

-0.48 

0.47 

0.62 

-0.26 

50506 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.04 

50506 

A 

1 

14 

24 

1.02 

0.44 

2.79 

0.26 

50506 

B 

0 

21 

36 

0.46 

0.24 

1.21 

0.03 

50506 

C 

0 

16 

28 

0.06 

0.30 

1.05 

-0.16 

50506 

D 

0 

7 

12 

-0.21 

0.47 

0.59 

-0.17 

50507 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50507 

A 

1 

20 

38 

0.81 

0.30 

1.56 

0.26 

50507 

B 

0 

11 

21 

0.26 

0.25 

1.00 

-0.08 

50507 

C 

0 

20 

38 

0.25 

0.23 

1.12 

-0.12 

50507 

D 

0 

2 

4 

-0.59 

0.40 

0.35 

-0.18 

50508 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.04 

50508 

A 

1 

32 

56 

0.90 

0.22 

1.33 

0.41 

50508 

B 

0 

8 

14 

-0.07 

0.30 

0.90 

-0.16 

50508 

C 

0 

10 

18 

-0.13 

0.27 

0.85 

-0.20 

50508 

D 

0 

7 

12 

-0.35 

0.69 

1.75 

-0.23 

50509 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.04 

50509 

A 

1 

34 

62 

0.91 

0.16 

0.83 

0.53 

50509 

B 

0 

7 

13 

-0.65 

0.39 

0.58 

-0.36 

50509 

C 

0 

6 

11 

-0.12 

0.35 

0.93 

-0.17 

50509 

D 

0 

8 

15 

-0.20 

0.42 

0.87 

-0.23 

50510 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50510 

A 

1 

53 

96 

0.59 

0.16 

1.03 

0.16 

50510 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50510 

C 

0 

2 

4 

-0.39 

0.17 

0.68 

-0.16 

50510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50511 

* 

-1 

4497 

94 

0.86 

0.02 

0.00 

-0.13 

50511 

A 

1 

249 

94 

1.75 

0.08 

0.93 

0.31 

50511 

B 

0 

8 

3 

0.41 

0.22 

0.66 

-0.17 

50511 

C 

0 

6 

2 

-0.08 

0.43 

0.51 

-0.20 

50511 

D 

0 

1 

0 

-3.09 

0.00 

0.02 

-0.22 

50512 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50512 

A 

1 

46 

88 

0.54 

0.14 

0.91 

0.49 

50512 

B 

0 

1 

2 

-0.79 

0.00 

0.48 

-0.15 

50512 

C 

0 

2 

4 

-0.51 

0.74 

0.82 

-0.16 

50512 

D 

0 

3 

6 

-1.62 

0.34 

0.24 

-0.45 

50513 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50513 

A 

1 

36 

68 

0.96 

0.19 

0.81 

0.56 

50513 

B 

0 

2 

4 

-1.09 

0.01 

0.26 

-0.26 

50513 

C 

0 

15 

28 

-0.41 

0.21 

0.71 

-0.47 

50513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50514 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.02 

50514 

A 

1 

52 

96 

0.78 

0.19 

0.80 

0.34 

50514 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50514 

C 

0 

2 

4 

-1.89 

1.23 

0.33 

-0.34 

50514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50515 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50515 

A 

1 

53 

96 

0.55 

0.17 

1.09 

0.12 

50515 

B 

0 

2 

4 

-0.23 

0.44 

0.96 

-0.12 

50515 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50516 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50516 

A 

1 

49 

91 

0.70 

0.18 

0.89 

0.37 

50516 

B 

0 

2 

4 

-1.71 

0.42 

0.20 

-0.33 

50516 

C 

0 

1 

2 

-1.92 

0.00 

0.15 

-0.26 

50516 

D 

0 

2 

4 

0.20 

0.06 

1.28 

-0.05 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50517 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.00 

50517 

A 

1 

48 

87 

0.78 

0.18 

1.30 

-0.15 

50517 

B 

0 

3 

5 

1.59 

0.93 

7.44 

0.14 

50517 

C 

0 

3 

5 

0.97 

0.71 

2.65 

0.02 

50517 

D 

0 

1 

2 

1.58 

0.00 

3.32 

0.08 

50518 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50518 

A 

1 

48 

96 

0.50 

0.16 

0.89 

0.38 

50518 

B 

0 

1 

2 

-1.42 

0.00 

0.27 

-0.23 

50518 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50518 

D 

0 

1 

2 

-1.97 

0.00 

0.16 

-0.30 

50519 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.06 

50519 

A 

1 

41 

82 

0.27 

0.12 

0.86 

0.46 

50519 

B 

0 

3 

6 

-1.26 

0.72 

0.57 

-0.36 

50519 

C 

0 

5 

10 

-0.33 

0.29 

1.00 

-0.14 

50519 

D 

0 

1 

2 

-2.22 

0.00 

0.13 

-0.35 

50520 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50520 

A 

1 

46 

88 

0.49 

0.15 

1.02 

0.17 

50520 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50520 

C 

0 

5 

10 

0.31 

0.27 

1.43 

-0.04 

50520 

D 

0 

1 

2 

-1.87 

0.00 

0.14 

-0.31 

50521 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

50521 

A 

1 

27 

49 

1.10 

0.19 

1.11 

0.32 

50521 

B 

0 

13 

24 

0.97 

0.32 

2.30 

0.12 

50521 

C 

0 

8 

15 

-0.11 

0.53 

0.85 

-0.27 

50521 

D 

0 

7 

13 

-0.42 

0.44 

0.47 

-0.34 

50522 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50522 

A 

1 

33 

62 

1.36 

0.21 

0.93 

0.50 

50522 

B 

0 

9 

17 

0.10 

0.38 

1.01 

-0.24 

50522 

C 

0 

7 

13 

-0.34 

0.43 

0.60 

-0.34 

50522 

D 

0 

4 

8 

0.18 

0.76 

1.45 

-0.14 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50523 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

50523 

A 

1 

37 

67 

1.03 

0.21 

1.00 

0.37 

50523 

B 

0 

14 

25 

0.29 

0.27 

1.42 

-0.18 

50523 

C 

0 

2 

4 

-0.54 

0.39 

0.42 

-0.18 

50523 

D 

0 

2 

4 

-1.49 

0.97 

0.23 

-0.32 

50524 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50524 

A 

1 

36 

72 

0.61 

0.22 

1.19 

0.46 

50524 

B 

0 

5 

10 

-1.41 

0.62 

0.62 

-0.39 

50524 

C 

0 

3 

6 

-0.53 

0.15 

0.69 

-0.14 

50524 

D 

0 

6 

12 

-0.43 

0.26 

0.91 

-0.17 

50525 

* 

-1 

4699 

99 

0.90 

0.02 

0.00 

0.00 

50525 

A 

1 

47 

76 

1.38 

0.17 

0.73 

0.60 

50525 

B 

0 

4 

6 

-0.28 

0.67 

0.99 

-0.23 

50525 

C 

0 

4 

6 

-0.34 

0.28 

0.48 

-0.24 

50525 

D 

0 

7 

11 

-0.80 

0.31 

0.36 

-0.45 

50526 

* 

-1 

4700 

99 

0.90 

0.02 

0.00 

0.01 

50526 

A 

1 

36 

59 

1.45 

0.17 

0.70 

0.64 

50526 

B 

0 

1 

2 

-0.31 

0.00 

0.38 

-0.11 

50526 

C 

0 

16 

26 

0.02 

0.18 

0.67 

-0.35 

50526 

D 

0 

8 

13 

-0.66 

0.46 

0.45 

-0.43 

50527 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50527 

A 

1 

41 

79 

0.79 

0.17 

1.05 

0.50 

50527 

B 

0 

4 

8 

-0.56 

0.53 

0.71 

-0.26 

50527 

C 

0 

1 

2 

-0.95 

0.00 

0.33 

-0.17 

50527 

D 

0 

6 

12 

-0.63 

0.34 

0.60 

-0.35 

50528 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50528 

A 

1 

31 

62 

0.77 

0.18 

0.92 

0.40 

50528 

B 

0 

7 

14 

0.51 

0.45 

2.08 

0.04 

50528 

C 

0 

4 

8 

-0.14 

0.35 

0.80 

-0.14 

50528 

D 

0 

8 

16 

-0.80 

0.39 

0.54 

-0.45 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50529 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50529 

A 

1 

18 

36 

1.01 

0.22 

0.80 

0.45 

50529 

B 

0 

6 

12 

-0.02 

0.35 

0.73 

-0.16 

50529 

C 

0 

22 

44 

0.24 

0.18 

1.06 

-0.16 

50529 

D 

0 

4 

8 

-0.63 

0.44 

0.42 

-0.31 

50530 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50530 

A 

1 

29 

58 

0.82 

0.18 

0.97 

0.49 

50530 

B 

0 

8 

16 

0.04 

0.37 

1.38 

-0.11 

50530 

C 

0 

8 

16 

-0.44 

0.44 

0.76 

-0.29 

50530 

D 

0 

5 

10 

-0.80 

0.48 

0.51 

-0.32 

50531 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.00 

50531 

A 

1 

27 

47 

1.43 

0.25 

1.29 

0.39 

50531 

B 

0 

6 

11 

0.25 

0.35 

0.69 

-0.20 

50531 

C 

0 

7 

12 

0.35 

0.28 

0.73 

-0.18 

50531 

D 

0 

17 

30 

0.64 

0.23 

1.17 

-0.16 

50532 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.04 

50532 

A 

1 

13 

22 

1.82 

0.52 

1.97 

0.49 

50532 

B 

0 

8 

14 

-0.06 

0.48 

1.10 

-0.15 

50532 

C 

0 

11 

19 

0.09 

0.34 

0.79 

-0.13 

50532 

D 

0 

27 

46 

0.15 

0.21 

0.88 

-0.21 

50533 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50533 

A 

1 

42 

82 

0.66 

0.17 

0.89 

0.39 

50533 

B 

0 

3 

6 

-1.15 

0.90 

0.67 

-0.32 

50533 

C 

0 

4 

8 

0.07 

0.61 

1.70 

-0.09 

50533 

D 

0 

2 

4 

-1.16 

0.97 

0.46 

-0.26 

50534 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.04 

50534 

A 

1 

51 

91 

0.60 

0.19 

0.97 

0.40 

50534 

B 

0 

1 

2 

-1.32 

0.00 

0.33 

-0.17 

50534 

C 

0 

1 

2 

-1.67 

0.00 

0.23 

-0.21 

50534 

D 

0 

3 

5 

-1.18 

0.27 

0.41 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50535 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50535 

A 

1 

13 

26 

1.04 

0.43 

1.95 

0.29 

50535 

B 

0 

4 

8 

0.25 

0.40 

0.76 

-0.05 

50535 

C 

0 

10 

20 

0.65 

0.32 

1.57 

0.08 

50535 

D 

0 

23 

46 

0.06 

0.22 

0.82 

-0.30 

50536 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50536 

A 

1 

18 

36 

0.38 

0.41 

3.67 

0.11 

50536 

B 

0 

1 

2 

-0.04 

0.00 

0.64 

-0.03 

50536 

C 

0 

8 

16 

0.17 

0.44 

1.53 

-0.01 

50536 

D 

0 

23 

46 

0.06 

0.22 

1.11 

-0.09 

50537 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50537 

A 

1 

37 

76 

0.82 

0.16 

0.74 

0.59 

50537 

B 

0 

2 

4 

-0.72 

0.18 

0.43 

-0.21 

50537 

C 

0 

8 

16 

-0.65 

0.34 

0.72 

-0.42 

50537 

D 

0 

2 

4 

-1.20 

1.08 

0.43 

-0.29 

50538 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50538 

A 

1 

40 

80 

0.61 

0.18 

0.74 

0.59 

50538 

B 

0 

3 

6 

-0.70 

0.34 

0.69 

-0.18 

50538 

C 

0 

4 

8 

-1.24 

0.53 

0.51 

-0.33 

50538 

D 

0 

3 

6 

-2.09 

0.26 

0.16 

-0.44 

50539 

* 

-1 

4472 

94 

0.86 

0.02 

0.00 

-0.12 

50539 

A 

1 

203 

70 

1.95 

0.07 

0.90 

0.49 

50539 

B 

0 

35 

12 

0.79 

0.14 

0.80 

-0.23 

50539 

C 

0 

30 

10 

0.85 

0.19 

1.02 

-0.20 

50539 

D 

0 

21 

7 

0.03 

0.32 

0.54 

-0.35 

50540 

* 

-1 

4479 

94 

0.86 

0.02 

0.00 

-0.12 

50540 

A 

1 

199 

71 

1.84 

0.07 

1.01 

0.46 

50540 

B 

0 

36 

13 

0.68 

0.14 

0.71 

-0.30 

50540 

C 

0 

22 

8 

1.35 

0.23 

1.68 

-0.05 

50540 

D 

0 

25 

9 

0.36 

0.15 

0.49 

-0.34 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50541 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50541 

A 

1 

32 

60 

1.42 

0.22 

0.77 

0.59 

50541 

B 

0 

9 

17 

-0.16 

0.47 

0.90 

-0.28 

50541 

C 

0 

9 

17 

-0.60 

0.32 

0.51 

-0.41 

50541 

D 

0 

3 

6 

-0.05 

0.55 

0.77 

-0.13 

50542 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50542 

A 

1 

38 

78 

0.52 

0.14 

0.90 

0.41 

50542 

B 

0 

6 

12 

-0.18 

0.36 

1.06 

-0.19 

50542 

C 

0 

2 

4 

-1.03 

0.08 

0.33 

-0.29 

50542 

D 

0 

3 

6 

-0.45 

0.84 

1.18 

-0.20 

50543 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.02 

50543 

A 

1 

31 

52 

1.35 

0.22 

0.88 

0.60 

50543 

B 

0 

10 

17 

0.30 

0.20 

0.94 

-0.11 

50543 

C 

0 

14 

23 

-0.11 

0.15 

0.60 

-0.31 

50543 

D 

0 

5 

8 

-1.29 

0.38 

0.20 

-0.45 

50544 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50544 

A 

1 

34 

68 

0.80 

0.20 

0.93 

0.44 

50544 

B 

0 

9 

18 

-0.46 

0.44 

1.10 

-0.34 

50544 

C 

0 

4 

8 

-0.51 

0.17 

0.52 

-0.22 

50544 

D 

0 

3 

6 

0.10 

0.55 

1.16 

-0.07 

50545 

* 

-1 

4490 

94 

0.87 

0.02 

0.00 

-0.11 

50545 

A 

1 

238 

88 

1.66 

0.07 

0.99 

0.37 

50545 

B 

0 

15 

6 

0.26 

0.16 

0.54 

-0.25 

50545 

C 

0 

15 

6 

0.58 

0.23 

0.90 

-0.19 

50545 

D 

0 

3 

1 

-0.84 

0.20 

0.16 

-0.21 

50546 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

50546 

A 

1 

45 

83 

0.60 

0.16 

1.02 

0.36 

50546 

B 

0 

4 

7 

-0.82 

0.47 

0.52 

-0.32 

50546 

C 

0 

3 

6 

0.30 

0.52 

1.62 

-0.03 

50546 

D 

0 

2 

4 

-0.91 

0.24 

0.38 

-0.24 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50547 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50547 

A 

1 

25 

49 

0.98 

0.25 

1.86 

0.52 

50547 

B 

0 

10 

20 

-0.37 

0.29 

0.69 

-0.24 

50547 

C 

0 

11 

22 

-0.27 

0.37 

1.01 

-0.22 

50547 

D 

0 

5 

10 

-0.68 

0.49 

0.54 

-0.24 

50548 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50548 

A 

1 

29 

58 

1.15 

0.21 

0.76 

0.60 

50548 

B 

0 

18 

36 

-0.40 

0.22 

0.65 

-0.54 

50548 

C 

0 

1 

2 

0.25 

0.00 

0.87 

-0.03 

50548 

D 

0 

2 

4 

-0.46 

0.35 

0.45 

-0.16 

50549 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

50549 

A 

1 

37 

67 

1.10 

0.22 

1.32 

0.43 

50549 

B 

0 

7 

13 

-0.03 

0.39 

0.88 

-0.20 

50549 

C 

0 

9 

16 

-0.30 

0.20 

0.57 

-0.31 

50549 

D 

0 

2 

4 

-0.06 

2.22 

2.89 

-0.10 

50550 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50550 

A 

1 

31 

62 

0.72 

0.22 

1.03 

0.44 

50550 

B 

0 

4 

8 

-0.34 

0.16 

0.64 

-0.18 

50550 

C 

0 

9 

18 

-0.33 

0.21 

0.73 

-0.28 

50550 

D 

0 

6 

12 

-0.25 

0.18 

0.72 

-0.19 

50551 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

50551 

A 

1 

39 

70 

0.86 

0.23 

1.06 

0.37 

50551 

B 

0 

13 

23 

0.07 

0.38 

2.88 

-0.16 

50551 

C 

0 

2 

4 

-1.11 

0.46 

0.32 

-0.20 

50551 

D 

0 

2 

4 

-2.30 

1.04 

0.14 

-0.35 

50552 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50552 

A 

1 

46 

87 

0.73 

0.18 

1.00 

0.45 

50552 

B 

0 

2 

4 

-0.34 

0.14 

0.76 

-0.13 

50552 

C 

0 

4 

8 

-1.28 

0.72 

0.52 

-0.39 

50552 

D 

0 

1 

2 

-1.44 

0.00 

0.25 

-0.20 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50553 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50553 

A 

1 

14 

29 

1.33 

0.30 

0.81 

0.49 

50553 

B 

0 

13 

27 

-0.03 

0.41 

1.36 

-0.19 

50553 

C 

0 

22 

45 

-0.01 

0.19 

0.87 

-0.27 

50553 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50554 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50554 

A 

1 

40 

78 

0.68 

0.22 

1.29 

0.23 

50554 

B 

0 

8 

16 

-0.18 

0.25 

0.93 

-0.23 

50554 

C 

0 

1 

2 

1.40 

0.00 

3.68 

0.09 

50554 

D 

0 

2 

4 

-0.26 

1.11 

1.18 

-0.12 

50555 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50555 

A 

1 

23 

47 

0.66 

0.18 

1.37 

0.12 

50555 

B 

0 

19 

39 

0.19 

0.27 

1.08 

-0.27 

50555 

C 

0 

4 

8 

1.53 

0.61 

4.61 

0.29 

50555 

D 

0 

3 

6 

0.47 

0.15 

0.90 

-0.02 

50556 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.06 

50556 

A 

1 

37 

73 

0.21 

0.19 

1.18 

0.19 

50556 

B 

0 

5 

10 

-0.70 

0.54 

0.92 

-0.23 

50556 

C 

0 

8 

16 

-0.15 

0.39 

1.79 

-0.09 

50556 

D 

0 

1 

2 

0.86 

0.00 

2.76 

0.10 

50557 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50557 

A 

1 

24 

47 

0.68 

0.29 

1.55 

0.23 

50557 

B 

0 

2 

4 

0.37 

0.30 

1.02 

0.00 

50557 

C 

0 

21 

41 

0.05 

0.24 

1.12 

-0.23 

50557 

D 

0 

4 

8 

0.35 

0.50 

1.24 

-0.01 

50558 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50558 

A 

1 

49 

98 

0.26 

0.16 

1.04 

0.01 

50558 

B 

0 

1 

2 

0.20 

0.00 

1.56 

-0.01 

50558 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50558 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg . Prsn Msr 

SE 

OUT.MSQ 

PTME 

50559 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50559 

A 

1 

46 

92 

0.67 

0.20 

0.98 

0.28 

50559 

B 

0 

1 

2 

- 0.28 

0.00 

0.83 

- 0.09 

50559 

C 

0 

2 

4 

- 1.43 

0.95 

0.39 

- 0.29 

50559 

D 

0 

1 

2 

0.05 

0.00 

1.15 

- 0.05 

50560 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.05 

50560 

A 

1 

56 

98 

0.36 

0.19 

1.03 

0.16 

50560 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50560 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50560 

D 

0 

1 

2 

- 1.37 

0.00 

0.40 

- 0.16 

50561 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50561 

A 

-1 

53 

100 

0.35 

0.18 

0.00 

0.00 

50561 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50561 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50561 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50562 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.06 

50562 

A 

1 

48 

92 

0.24 

0.17 

1.01 

0.21 

50562 

B 

0 

3 

6 

- 0.95 

1.02 

1.51 

- 0.23 

50562 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50562 

D 

0 

1 

2 

0.10 

0.00 

1.60 

- 0.01 

50563 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50563 

A 

1 

46 

90 

0.50 

0.17 

1.02 

0.16 

50563 

B 

0 

1 

2 

- 0.88 

0.00 

0.43 

- 0.16 

50563 

C 

0 

4 

8 

0.05 

0.76 

2.37 

- 0.10 

50563 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50564 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50564 

A 

1 

28 

55 

0.96 

0.25 

1.01 

0.50 

50564 

B 

0 

4 

8 

- 0.13 

0.46 

0.97 

- 0.10 

50564 

C 

0 

14 

27 

- 0.23 

0.28 

1.00 

- 0.25 

50564 

D 

0 

5 

10 

- 1.20 

0.46 

0.40 

- 0.37 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50565 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

50565 

A 

1 

34 

68 

0.93 

0.22 

1.15 

0.26 

50565 

B 

0 

2 

4 

0.84 

0.46 

1.67 

0.02 

50565 

C 

0 

8 

16 

0.59 

0.36 

1.91 

-0.04 

50565 

D 

0 

6 

12 

-0.46 

0.49 

0.66 

-0.34 

50566 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50566 

A 

1 

42 

81 

0.65 

0.15 

0.79 

0.46 

50566 

B 

0 

1 

2 

-0.21 

0.00 

0.77 

-0.07 

50566 

C 

0 

3 

6 

-1.08 

0.97 

0.83 

-0.31 

50566 

D 

0 

6 

12 

-0.61 

0.65 

1.45 

-0.31 

50567 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50567 

A 

1 

33 

67 

0.94 

0.22 

0.76 

0.55 

50567 

B 

0 

6 

12 

-0.36 

0.58 

1.50 

-0.18 

50567 

C 

0 

2 

4 

-0.68 

0.25 

0.49 

-0.14 

50567 

D 

0 

8 

16 

-1.23 

0.53 

0.58 

-0.47 

50568 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.06 

50568 

A 

1 

36 

67 

0.72 

0.31 

1.19 

0.41 

50568 

B 

0 

5 

9 

-0.72 

0.43 

1.04 

-0.16 

50568 

C 

0 

6 

11 

-0.66 

0.46 

1.24 

-0.16 

50568 

D 

0 

7 

13 

-1.19 

0.59 

1.38 

-0.29 

50569 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.07 

50569 

A 

1 

36 

64 

0.72 

0.18 

0.66 

0.67 

50569 

B 

0 

9 

16 

-1.29 

0.41 

0.68 

-0.40 

50569 

C 

0 

4 

7 

-1.66 

0.46 

0.33 

-0.33 

50569 

D 

0 

7 

13 

-0.96 

0.28 

0.58 

-0.26 

50570 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50570 

A 

1 

33 

69 

1.02 

0.17 

0.63 

0.68 

50570 

B 

0 

6 

13 

-1.82 

0.37 

0.19 

-0.63 

50570 

C 

0 

2 

4 

-0.90 

0.43 

0.37 

-0.20 

50570 

D 

0 

7 

15 

-0.21 

0.33 

0.95 

-0.19 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50571 

* 

-1 

4495 

94 

0.90 

0.02 

0.00 

0.00 

50571 

A 

1 

236 

89 

1.05 

0.06 

0.91 

0.45 

50571 

B 

0 

11 

4 

-0.07 

0.22 

0.69 

-0.19 

50571 

C 

0 

13 

5 

-0.51 

0.15 

0.41 

-0.30 

50571 

D 

0 

6 

2 

-0.95 

0.20 

0.25 

-0.27 

50572 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50572 

A 

1 

35 

69 

0.92 

0.14 

0.84 

0.57 

50572 

B 

0 

7 

14 

-0.14 

0.16 

0.63 

-0.28 

50572 

C 

0 

2 

4 

-0.02 

0.34 

0.70 

-0.12 

50572 

D 

0 

7 

14 

-0.48 

0.38 

0.61 

-0.42 

50573 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50573 

A 

1 

41 

79 

0.94 

0.21 

0.96 

0.43 

50573 

B 

0 

4 

8 

-0.45 

0.54 

0.86 

-0.22 

50573 

C 

0 

1 

2 

0.15 

0.00 

1.03 

-0.05 

50573 

D 

0 

6 

12 

-0.71 

0.30 

0.57 

-0.35 

50574 

* 

-1 

4702 

99 

0.91 

0.02 

0.00 

0.02 

50574 

A 

1 

24 

41 

1.29 

0.23 

1.12 

0.44 

50574 

B 

0 

10 

17 

-0.12 

0.38 

0.81 

-0.31 

50574 

C 

0 

10 

17 

0.62 

0.33 

1.25 

-0.02 

50574 

D 

0 

15 

25 

0.25 

0.22 

0.82 

-0.21 

50575 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50575 

A 

1 

42 

78 

0.84 

0.14 

0.73 

0.65 

50575 

B 

0 

2 

4 

-0.67 

0.14 

0.43 

-0.21 

50575 

C 

0 

2 

4 

-1.17 

0.12 

0.26 

-0.30 

50575 

D 

0 

8 

15 

-0.76 

0.22 

0.47 

-0.48 

50576 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.04 

50576 

A 

1 

40 

69 

0.89 

0.20 

0.99 

0.56 

50576 

B 

0 

4 

7 

-0.80 

0.33 

0.48 

-0.24 

50576 

C 

0 

2 

3 

-1.32 

1.01 

0.38 

-0.24 

50576 

D 

0 

12 

21 

-0.65 

0.24 

0.66 

-0.39 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50577 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50577 

A 

1 

44 

90 

0.30 

0.14 

1.02 

0.16 

50577 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50577 

C 

0 

4 

8 

-0.28 

0.57 

1.40 

-0.17 

50577 

D 

0 

1 

2 

0.18 

0.00 

1.25 

-0.01 

50578 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50578 

A 

1 

43 

86 

0.55 

0.14 

1.03 

0.30 

50578 

B 

0 

4 

8 

0.08 

0.61 

1.65 

-0.11 

50578 

C 

0 

2 

4 

-1.15 

0.57 

0.33 

-0.33 

50578 

D 

0 

1 

2 

-0.15 

0.00 

0.78 

-0.08 

50579 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50579 

A 

1 

44 

88 

0.37 

0.17 

1.09 

0.25 

50579 

B 

0 

3 

6 

-0.73 

0.36 

0.58 

-0.16 

50579 

C 

0 

1 

2 

0.77 

0.00 

2.29 

0.05 

50579 

D 

0 

2 

4 

-1.57 

4.82 

27.44 

-0.25 

50580 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

-0.01 

50580 

A 

1 

46 

90 

1.05 

0.16 

0.99 

0.22 

50580 

B 

0 

2 

4 

-0.08 

1.13 

0.97 

-0.18 

50580 

C 

0 

1 

2 

-1.06 

0.00 

0.21 

-0.25 

50580 

D 

0 

2 

4 

1.12 

0.93 

2.76 

0.03 

50581 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50581 

A 

1 

50 

94 

0.40 

0.18 

1.04 

0.11 

50581 

B 

0 

3 

6 

-0.19 

0.31 

1.03 

-0.11 

50581 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50581 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50582 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

50582 

A 

1 

37 

66 

0.77 

0.26 

1.28 

0.23 

50582 

B 

0 

6 

11 

-0.32 

0.49 

0.88 

-0.20 

50582 

C 

0 

9 

16 

0.52 

0.40 

3.02 

0.00 

50582 

D 

0 

4 

7 

-0.42 

0.56 

0.85 

-0.18 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50583 

* 

-1 

4499 

94 

0.88 

0.02 

0.00 

-0.07 

50583 

A 

1 

213 

81 

1.52 

0.07 

0.82 

0.49 

50583 

B 

0 

12 

5 

0.23 

0.20 

0.60 

-0.21 

50583 

C 

0 

26 

10 

0.40 

0.20 

0.87 

-0.26 

50583 

D 

0 

11 

4 

-0.53 

0.22 

0.30 

-0.34 

50584 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50584 

A 

1 

30 

61 

0.79 

0.19 

0.71 

0.56 

50584 

B 

0 

7 

14 

-0.84 

0.33 

0.52 

-0.31 

50584 

C 

0 

4 

8 

-0.11 

0.41 

1.04 

-0.07 

50584 

D 

0 

8 

16 

-1.00 

0.64 

0.82 

-0.39 

50585 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50585 

A 

1 

37 

74 

0.63 

0.15 

1.04 

0.35 

50585 

B 

0 

7 

14 

-0.18 

0.18 

0.69 

-0.30 

50585 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50585 

D 

0 

6 

12 

0.10 

0.21 

0.93 

-0.15 

50586 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50586 

A 

1 

36 

72 

0.95 

0.14 

0.80 

0.55 

50586 

B 

0 

1 

2 

0.09 

0.00 

0.69 

-0.08 

50586 

C 

0 

8 

16 

-0.24 

0.24 

0.59 

-0.42 

50586 

D 

0 

5 

10 

-0.13 

0.13 

0.57 

-0.28 

50587 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50587 

A 

1 

26 

52 

1.10 

0.19 

0.83 

0.61 

50587 

B 

0 

6 

12 

-0.43 

0.35 

0.60 

-0.22 

50587 

C 

0 

6 

12 

-0.78 

0.45 

0.48 

-0.32 

50587 

D 

0 

12 

24 

-0.34 

0.36 

0.80 

-0.30 

50588 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50588 

A 

1 

37 

76 

0.91 

0.19 

0.84 

0.55 

50588 

B 

0 

5 

10 

-1.19 

0.32 

0.31 

-0.45 

50588 

C 

0 

2 

4 

-0.78 

0.59 

0.47 

-0.21 

50588 

D 

0 

5 

10 

-0.22 

0.10 

0.70 

-0.19 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50589 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.06 

50589 

A 

1 

33 

66 

0.51 

0.20 

0.93 

0.45 

50589 

B 

0 

3 

6 

-0.78 

0.58 

0.71 

-0.16 

50589 

C 

0 

6 

12 

-0.69 

0.50 

0.96 

-0.20 

50589 

D 

0 

8 

16 

-0.87 

0.65 

2.20 

-0.30 

50590 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50590 

A 

1 

36 

75 

0.62 

0.14 

0.83 

0.58 

50590 

B 

0 

2 

4 

-1.88 

0.45 

0.16 

-0.44 

50590 

C 

0 

4 

8 

-0.71 

0.25 

0.51 

-0.29 

50590 

D 

0 

6 

13 

-0.43 

0.34 

0.90 

-0.26 

50591 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50591 

A 

1 

35 

70 

0.87 

0.16 

0.75 

0.59 

50591 

B 

0 

2 

4 

0.58 

1.27 

2.82 

0.03 

50591 

C 

0 

5 

10 

-1.24 

0.45 

0.35 

-0.46 

50591 

D 

0 

8 

16 

-0.59 

0.32 

0.59 

-0.37 

50592 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50592 

A 

1 

39 

78 

0.61 

0.21 

0.97 

0.39 

50592 

B 

0 

2 

4 

0.05 

0.60 

1.40 

-0.04 

50592 

C 

0 

4 

8 

-0.51 

0.40 

0.89 

-0.18 

50592 

D 

0 

5 

10 

-1.08 

0.59 

0.70 

-0.34 

50593 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50593 

A 

1 

30 

57 

0.94 

0.26 

1.19 

0.49 

50593 

B 

0 

7 

13 

-0.64 

0.30 

0.54 

-0.27 

50593 

C 

0 

6 

11 

-0.67 

0.20 

0.49 

-0.25 

50593 

D 

0 

10 

19 

-0.18 

0.42 

1.42 

-0.18 

50594 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50594 

A 

1 

39 

72 

0.87 

0.16 

0.95 

0.46 

50594 

B 

0 

2 

4 

-0.57 

0.27 

0.42 

-0.20 

50594 

C 

0 

8 

15 

-0.15 

0.32 

1.03 

-0.27 

50594 

D 

0 

5 

9 

-0.24 

0.62 

0.98 

-0.24 



easyCBM CCSS Fifth Grade Math Measure Development 


321 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50595 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50595 

A 

1 

45 

85 

0.56 

0.19 

0.91 

0.35 

50595 

B 

0 

1 

2 

-2.44 

0.00 

0.10 

-0.29 

50595 

C 

0 

6 

11 

-0.81 

0.38 

0.73 

-0.31 

50595 

D 

0 

1 

2 

1.25 

0.00 

4.00 

0.09 

50596 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.02 

50596 

A 

1 

52 

93 

0.76 

0.18 

0.99 

0.26 

50596 

B 

0 

1 

2 

-1.30 

0.00 

0.25 

-0.20 

50596 

C 

0 

3 

5 

-0.28 

0.24 

0.73 

-0.17 

50596 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50597 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

-0.01 

50597 

A 

1 

33 

59 

1.48 

0.25 

0.93 

0.41 

50597 

B 

0 

16 

29 

0.46 

0.24 

1.23 

-0.24 

50597 

C 

0 

3 

5 

-0.04 

1.39 

1.95 

-0.17 

50597 

D 

0 

4 

7 

-0.15 

0.42 

0.51 

-0.22 

50598 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50598 

A 

1 

32 

60 

1.33 

0.24 

0.85 

0.53 

50598 

B 

0 

9 

17 

0.29 

0.13 

0.87 

-0.16 

50598 

C 

0 

3 

6 

-0.47 

0.41 

0.46 

-0.22 

50598 

D 

0 

9 

17 

-0.41 

0.31 

0.58 

-0.39 

50599 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.07 

50599 

A 

1 

40 

82 

0.41 

0.15 

0.62 

0.66 

50599 

B 

0 

2 

4 

-1.57 

0.30 

0.33 

-0.25 

50599 

C 

0 

2 

4 

-2.09 

0.37 

0.20 

-0.33 

50599 

D 

0 

5 

10 

-1.78 

0.71 

0.70 

-0.46 

50600 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

50600 

A 

1 

39 

71 

1.02 

0.22 

0.89 

0.45 

50600 

B 

0 

2 

4 

-0.49 

0.13 

0.49 

-0.15 

50600 

C 

0 

4 

7 

0.00 

0.88 

1.69 

-0.12 

50600 

D 

0 

10 

18 

-0.50 

0.28 

0.63 

-0.37 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50601 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50601 

A 

1 

47 

85 

0.80 

0.16 

0.74 

0.52 

50601 

B 

0 

2 

4 

-1.04 

0.74 

0.50 

-0.22 

50601 

C 

0 

5 

9 

-1.27 

1.00 

3.28 

-0.41 

50601 

D 

0 

1 

2 

-1.30 

0.00 

0.30 

-0.18 

50602 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50602 

A 

1 

46 

90 

0.60 

0.22 

0.90 

0.34 

50602 

B 

0 

1 

2 

-0.68 

0.00 

0.69 

-0.10 

50602 

C 

0 

3 

6 

-0.68 

0.62 

1.00 

-0.18 

50602 

D 

0 

1 

2 

-3.09 

0.00 

0.06 

-0.32 

50603 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.02 

50603 

A 

1 

47 

92 

0.80 

0.16 

0.93 

0.30 

50603 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50603 

C 

0 

4 

8 

-0.44 

0.36 

0.56 

-0.30 

50603 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50604 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.02 

50604 

A 

1 

48 

94 

0.72 

0.21 

0.96 

0.33 

50604 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50604 

C 

0 

3 

6 

-1.40 

0.53 

0.40 

-0.33 

50604 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50605 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50605 

A 

1 

44 

88 

0.59 

0.14 

0.84 

0.52 

50605 

B 

0 

1 

2 

-1.14 

0.00 

0.32 

-0.21 

50605 

C 

0 

3 

6 

-1.01 

0.60 

0.53 

-0.33 

50605 

D 

0 

2 

4 

-1.18 

0.11 

0.31 

-0.30 

50606 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

50606 

A 

1 

50 

91 

0.84 

0.19 

1.01 

0.36 

50606 

B 

0 

3 

5 

-0.96 

0.71 

0.55 

-0.28 

50606 

C 

0 

1 

2 

-1.54 

0.00 

0.21 

-0.22 

50606 

D 

0 

1 

2 

-0.18 

0.00 

0.83 

-0.08 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50607 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.06 

50607 

A 

1 

48 

87 

0.44 

0.23 

1.10 

0.39 

50607 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50607 

C 

0 

5 

9 

-1.02 

0.24 

0.74 

-0.23 

50607 

D 

0 

2 

4 

-2.56 

1.30 

0.28 

-0.33 

50608 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50608 

A 

1 

43 

86 

0.59 

0.18 

0.77 

0.58 

50608 

B 

0 

3 

6 

-1.40 

0.37 

0.36 

-0.32 

50608 

C 

0 

3 

6 

-1.75 

0.40 

0.26 

-0.39 

50608 

D 

0 

1 

2 

-1.72 

0.00 

0.23 

-0.22 

50609 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50609 

A 

1 

51 

96 

0.58 

0.21 

1.01 

0.28 

50609 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50609 

C 

0 

1 

2 

-0.92 

0.00 

0.58 

-0.13 

50609 

D 

0 

1 

2 

-2.37 

0.00 

0.14 

-0.26 

50610 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50610 

A 

1 

44 

88 

1.00 

0.23 

0.78 

0.48 

50610 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50610 

C 

0 

4 

8 

-1.37 

0.44 

0.40 

-0.37 

50610 

D 

0 

2 

4 

-1.61 

0.51 

0.26 

-0.28 

50611 

* 

-1 

4496 

94 

0.86 

0.02 

0.00 

-0.13 

50611 

A 

1 

243 

92 

1.71 

0.08 

1.02 

0.27 

50611 

B 

0 

20 

8 

0.52 

0.22 

0.89 

-0.24 

50611 

C 

0 

2 

1 

-0.43 

1.12 

0.40 

-0.14 

50611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50612 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.03 

50612 

A 

1 

48 

83 

0.72 

0.21 

1.04 

0.34 

50612 

B 

0 

1 

2 

-0.04 

0.00 

0.99 

-0.05 

50612 

C 

0 

7 

12 

-0.71 

0.24 

0.59 

-0.32 

50612 

D 

0 

2 

3 

-0.22 

0.75 

1.07 

-0.10 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50613 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.05 

50613 

A 

1 

35 

65 

0.61 

0.19 

1.15 

0.35 

50613 

B 

0 

7 

13 

0.05 

0.37 

1.36 

-0.07 

50613 

C 

0 

10 

19 

0.02 

0.24 

1.17 

-0.10 

50613 

D 

0 

2 

4 

-3.34 

1.26 

0.06 

-0.56 

50614 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50614 

A 

1 

49 

92 

0.94 

0.21 

0.85 

0.38 

50614 

B 

0 

2 

4 

0.02 

0.64 

1.43 

-0.09 

50614 

C 

0 

1 

2 

-1.00 

0.00 

0.42 

-0.15 

50614 

D 

0 

1 

2 

-4.60 

0.00 

0.01 

-0.46 

50615 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50615 

A 

1 

30 

59 

0.84 

0.23 

1.05 

0.44 

50615 

B 

0 

11 

22 

-0.02 

0.22 

1.13 

-0.18 

50615 

C 

0 

1 

2 

-0.14 

0.00 

0.67 

-0.06 

50615 

D 

0 

9 

18 

-0.50 

0.32 

0.66 

-0.35 

50616 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

50616 

A 

1 

40 

80 

0.92 

0.15 

0.78 

0.56 

50616 

B 

0 

3 

6 

-0.66 

0.33 

0.43 

-0.30 

50616 

C 

0 

6 

12 

-0.59 

0.22 

0.46 

-0.42 

50616 

D 

0 

1 

2 

-0.20 

0.00 

0.61 

-0.11 

50617 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50617 

A 

1 

39 

75 

0.72 

0.19 

0.77 

0.61 

50617 

B 

0 

4 

8 

-0.85 

0.54 

0.71 

-0.22 

50617 

C 

0 

3 

6 

-1.61 

0.51 

0.31 

-0.33 

50617 

D 

0 

6 

12 

-1.31 

0.25 

0.39 

-0.40 

50618 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50618 

A 

1 

46 

94 

0.48 

0.16 

1.02 

0.18 

50618 

B 

0 

3 

6 

-0.33 

0.56 

0.96 

-0.18 

50618 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50618 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50619 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50619 

A 

1 

43 

88 

0.54 

0.23 

0.96 

0.31 

50619 

B 

0 

3 

6 

-0.40 

0.60 

1.27 

-0.13 

50619 

C 

0 

3 

6 

-1.34 

0.12 

0.36 

-0.29 

50619 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50620 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50620 

A 

1 

38 

75 

0.69 

0.16 

0.81 

0.56 

50620 

B 

0 

4 

8 

-0.50 

0.38 

0.71 

-0.23 

50620 

C 

0 

7 

14 

-0.79 

0.20 

0.46 

-0.43 

50620 

D 

0 

2 

4 

-0.68 

0.24 

0.48 

-0.19 

50621 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50621 

A 

1 

44 

83 

0.79 

0.19 

0.94 

0.47 

50621 

B 

0 

2 

4 

-0.48 

0.26 

0.61 

-0.15 

50621 

C 

0 

4 

8 

-0.96 

0.23 

0.39 

-0.32 

50621 

D 

0 

3 

6 

-0.91 

0.26 

0.41 

-0.27 

50622 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50622 

A 

1 

39 

75 

0.95 

0.19 

0.83 

0.55 

50622 

B 

0 

3 

6 

-0.74 

0.26 

0.43 

-0.24 

50622 

C 

0 

3 

6 

-0.52 

0.41 

0.59 

-0.20 

50622 

D 

0 

7 

13 

-0.80 

0.43 

0.63 

-0.40 

50623 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.06 

50623 

A 

1 

30 

60 

0.68 

0.18 

0.79 

0.56 

50623 

B 

0 

5 

10 

-0.75 

0.33 

0.59 

-0.23 

50623 

C 

0 

8 

16 

0.17 

0.18 

1.32 

0.02 

50623 

D 

0 

7 

14 

-1.78 

0.36 

0.24 

-0.62 

50624 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50624 

A 

1 

33 

65 

0.93 

0.20 

1.16 

0.50 

50624 

B 

0 

8 

16 

-0.80 

0.20 

0.38 

-0.47 

50624 

C 

0 

2 

4 

-0.88 

0.03 

0.30 

-0.23 

50624 

D 

0 

8 

16 

0.32 

0.35 

1.56 

-0.06 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50625 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50625 

A 

1 

37 

70 

1.00 

0.21 

0.92 

0.60 

50625 

B 

0 

2 

4 

-0.80 

0.46 

0.47 

-0.16 

50625 

C 

0 

4 

8 

-0.97 

0.26 

0.39 

-0.27 

50625 

D 

0 

10 

19 

-0.93 

0.37 

0.71 

-0.44 

50626 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.01 

50626 

A 

1 

41 

79 

1.10 

0.22 

0.94 

0.47 

50626 

B 

0 

5 

10 

-0.40 

0.29 

0.61 

-0.25 

50626 

C 

0 

3 

6 

-0.28 

0.54 

0.77 

-0.17 

50626 

D 

0 

3 

6 

-1.26 

0.95 

0.40 

-0.34 

50627 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50627 

A 

1 

29 

58 

0.79 

0.17 

0.97 

0.37 

50627 

B 

0 

7 

14 

0.15 

0.34 

1.19 

-0.11 

50627 

C 

0 

9 

18 

0.09 

0.48 

2.69 

-0.16 

50627 

D 

0 

5 

10 

-0.42 

0.50 

0.63 

-0.27 

50628 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.02 

50628 

A 

1 

31 

58 

0.99 

0.15 

0.86 

0.51 

50628 

B 

0 

6 

11 

0.44 

0.32 

1.21 

-0.07 

50628 

C 

0 

9 

17 

0.03 

0.18 

0.68 

-0.30 

50628 

D 

0 

7 

13 

-0.18 

0.25 

0.60 

-0.35 

50629 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50629 

A 

1 

20 

41 

1.29 

0.23 

0.84 

0.48 

50629 

B 

0 

17 

35 

0.52 

0.29 

1.53 

-0.04 

50629 

C 

0 

3 

6 

-0.62 

0.21 

0.30 

-0.25 

50629 

D 

0 

9 

18 

-0.46 

0.26 

0.48 

-0.40 

50630 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50630 

A 

1 

29 

56 

1.27 

0.27 

0.86 

0.55 

50630 

B 

0 

5 

10 

-0.10 

0.48 

1.05 

-0.13 

50630 

C 

0 

10 

19 

-0.30 

0.35 

0.82 

-0.25 

50630 

D 

0 

8 

15 

-0.87 

0.48 

0.67 

-0.38 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50631 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50631 

A 

1 

23 

46 

1.09 

0.16 

0.62 

0.66 

50631 

B 

0 

6 

12 

-0.30 

0.31 

0.68 

-0.20 

50631 

C 

0 

16 

32 

-0.30 

0.25 

0.85 

-0.37 

50631 

D 

0 

5 

10 

-0.73 

0.32 

0.41 

-0.31 

50632 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50632 

A 

1 

27 

55 

0.98 

0.24 

0.95 

0.50 

50632 

B 

0 

6 

12 

-0.24 

0.27 

0.69 

-0.19 

50632 

C 

0 

8 

16 

-0.17 

0.39 

0.93 

-0.20 

50632 

D 

0 

8 

16 

-0.47 

0.38 

0.71 

-0.30 

50633 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50633 

A 

1 

23 

45 

1.16 

0.22 

0.87 

0.52 

50633 

B 

0 

7 

14 

0.16 

0.26 

0.84 

-0.12 

50633 

C 

0 

10 

20 

0.02 

0.34 

0.98 

-0.21 

50633 

D 

0 

11 

22 

-0.22 

0.32 

0.68 

-0.33 

50634 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50634 

A 

1 

28 

56 

1.40 

0.25 

0.61 

0.67 

50634 

B 

0 

2 

4 

-1.35 

0.09 

0.19 

-0.25 

50634 

C 

0 

12 

24 

-0.49 

0.31 

0.65 

-0.37 

50634 

D 

0 

8 

16 

-0.66 

0.19 

0.45 

-0.34 

50635 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.02 

50635 

A 

1 

26 

51 

1.10 

0.22 

1.01 

0.45 

50635 

B 

0 

8 

16 

0.32 

0.21 

0.91 

-0.13 

50635 

C 

0 

3 

6 

-0.08 

0.40 

0.60 

-0.17 

50635 

D 

0 

14 

27 

0.11 

0.25 

0.89 

-0.31 

50636 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

50636 

A 

1 

33 

62 

1.26 

0.24 

0.94 

0.50 

50636 

B 

0 

4 

8 

-0.03 

0.59 

0.94 

-0.16 

50636 

C 

0 

8 

15 

-0.24 

0.28 

0.61 

-0.30 

50636 

D 

0 

8 

15 

-0.07 

0.28 

0.71 

-0.25 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50637 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50637 

A 

1 

30 

61 

0.80 

0.25 

1.00 

0.47 

50637 

B 

0 

5 

10 

-1.11 

0.21 

0.35 

-0.35 

50637 

C 

0 

4 

8 

0.40 

0.46 

2.00 

0.02 

50637 

D 

0 

10 

20 

-0.57 

0.32 

0.84 

-0.32 

50638 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50638 

A 

1 

31 

61 

1.11 

0.24 

0.86 

0.53 

50638 

B 

0 

8 

16 

-0.58 

0.27 

0.50 

-0.35 

50638 

C 

0 

5 

10 

-0.70 

0.52 

0.64 

-0.29 

50638 

D 

0 

7 

14 

0.07 

0.34 

1.21 

-0.13 

50639 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50639 

A 

1 

26 

53 

1.04 

0.18 

0.77 

0.58 

50639 

B 

0 

7 

14 

-0.65 

0.50 

0.61 

-0.31 

50639 

C 

0 

3 

6 

-0.06 

0.83 

1.07 

-0.08 

50639 

D 

0 

13 

27 

-0.47 

0.34 

1.28 

-0.37 

50640 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50640 

A 

1 

17 

34 

1.35 

0.25 

0.98 

0.60 

50640 

B 

0 

11 

22 

-0.32 

0.25 

0.52 

-0.38 

50640 

C 

0 

13 

26 

0.22 

0.22 

0.93 

-0.13 

50640 

D 

0 

9 

18 

0.04 

0.21 

0.68 

-0.18 

50641 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50641 

A 

1 

34 

65 

0.81 

0.25 

1.12 

0.37 

50641 

B 

0 

1 

2 

-0.34 

0.00 

0.61 

-0.08 

50641 

C 

0 

8 

15 

-0.61 

0.25 

0.60 

-0.34 

50641 

D 

0 

9 

17 

0.12 

0.26 

1.29 

-0.11 

50642 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50642 

A 

1 

27 

55 

1.13 

0.31 

1.29 

0.38 

50642 

B 

0 

4 

8 

-0.22 

0.53 

0.80 

-0.16 

50642 

C 

0 

7 

14 

-0.13 

0.47 

1.00 

-0.19 

50642 

D 

0 

11 

22 

0.06 

0.41 

1.78 

-0.19 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50643 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50643 

A 

1 

30 

61 

0.61 

0.20 

1.22 

0.22 

50643 

B 

0 

5 

10 

0.74 

0.28 

1.81 

0.10 

50643 

C 

0 

10 

20 

0.31 

0.22 

1.27 

-0.05 

50643 

D 

0 

4 

8 

-1.20 

0.67 

0.42 

-0.44 

50644 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.01 

50644 

A 

1 

36 

64 

0.99 

0.22 

1.18 

0.24 

50644 

B 

0 

9 

16 

0.26 

0.57 

1.89 

-0.17 

50644 

C 

0 

6 

11 

0.70 

0.20 

1.31 

-0.02 

50644 

D 

0 

5 

9 

0.13 

0.37 

0.90 

-0.15 

50645 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50645 

A 

1 

48 

89 

0.69 

0.17 

0.91 

0.48 

50645 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50645 

C 

0 

3 

6 

-0.75 

0.40 

0.57 

-0.24 

50645 

D 

0 

3 

6 

-1.66 

0.51 

0.26 

-0.41 

50646 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50646 

A 

1 

42 

84 

0.63 

0.18 

1.00 

0.34 

50646 

B 

0 

6 

12 

-0.56 

0.31 

0.69 

-0.32 

50646 

C 

0 

1 

2 

-1.26 

0.00 

0.27 

-0.21 

50646 

D 

0 

1 

2 

0.88 

0.00 

2.30 

0.05 

50647 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.02 

50647 

A 

1 

45 

83 

0.89 

0.14 

0.89 

0.43 

50647 

B 

0 

4 

7 

0.30 

0.64 

1.70 

-0.10 

50647 

C 

0 

3 

6 

-0.95 

0.32 

0.31 

-0.37 

50647 

D 

0 

2 

4 

-0.65 

0.51 

0.42 

-0.25 

50648 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50648 

A 

1 

40 

77 

0.71 

0.19 

1.10 

0.42 

50648 

B 

0 

3 

6 

-0.22 

0.57 

1.06 

-0.12 

50648 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50648 

D 

0 

9 

17 

-0.67 

0.35 

0.73 

-0.39 



easyCBM CCSS Fifth Grade Math Measure Development 


330 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50649 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50649 

A 

1 

35 

66 

0.88 

0.16 

0.84 

0.58 

50649 

B 

0 

2 

4 

0.00 

0.23 

0.79 

-0.07 

50649 

C 

0 

8 

15 

-0.21 

0.20 

0.72 

-0.24 

50649 

D 

0 

8 

15 

-0.88 

0.39 

0.52 

-0.49 

50650 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50650 

A 

1 

41 

79 

0.83 

0.15 

0.95 

0.51 

50650 

B 

0 

2 

4 

-0.97 

0.24 

0.29 

-0.29 

50650 

C 

0 

9 

17 

-0.35 

0.28 

0.70 

-0.40 

50650 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50651 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.06 

50651 

A 

1 

21 

42 

0.15 

0.30 

2.26 

0.03 

50651 

B 

0 

10 

20 

0.11 

0.34 

1.45 

0.00 

50651 

C 

0 

9 

18 

0.15 

0.33 

1.60 

0.01 

50651 

D 

0 

10 

20 

0.00 

0.45 

3.10 

-0.05 

50652 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.02 

50652 

A 

1 

20 

39 

1.78 

0.37 

1.11 

0.58 

50652 

B 

0 

11 

22 

0.09 

0.34 

0.89 

-0.21 

50652 

C 

0 

9 

18 

-0.07 

0.22 

0.59 

-0.24 

50652 

D 

0 

11 

22 

-0.05 

0.26 

0.65 

-0.26 

50653 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50653 

A 

1 

24 

47 

0.75 

0.25 

1.22 

0.31 

50653 

B 

0 

11 

22 

0.44 

0.35 

1.81 

0.05 

50653 

C 

0 

5 

10 

-1.15 

0.80 

0.68 

-0.37 

50653 

D 

0 

11 

22 

-0.07 

0.29 

0.91 

-0.15 

50654 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.01 

50654 

A 

1 

13 

25 

1.44 

0.55 

3.02 

0.28 

50654 

B 

0 

24 

47 

0.55 

0.25 

1.10 

-0.11 

50654 

C 

0 

3 

6 

0.53 

1.51 

4.16 

-0.03 

50654 

D 

0 

11 

22 

0.30 

0.35 

0.79 

-0.14 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50655 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50655 

A 

1 

8 

16 

0.87 

0.46 

1.60 

0.26 

50655 

B 

0 

23 

47 

0.07 

0.19 

1.05 

-0.18 

50655 

C 

0 

7 

14 

0.82 

0.29 

1.56 

0.22 

50655 

D 

0 

11 

22 

-0.12 

0.30 

0.78 

-0.20 

50656 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.08 

50656 

A 

1 

11 

21 

0.21 

0.30 

1.48 

0.16 

50656 

B 

0 

19 

36 

0.16 

0.15 

1.19 

0.19 

50656 

C 

0 

10 

19 

-0.13 

0.33 

1.15 

-0.01 

50656 

D 

0 

13 

25 

-0.75 

0.38 

0.89 

-0.35 

50657 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50657 

A 

1 

14 

28 

1.30 

0.45 

1.16 

0.46 

50657 

B 

0 

16 

32 

0.34 

0.23 

1.29 

0.07 

50657 

C 

0 

7 

14 

-0.71 

0.47 

0.52 

-0.25 

50657 

D 

0 

13 

26 

-0.69 

0.34 

0.57 

-0.35 

50658 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50658 

A 

1 

9 

18 

1.16 

0.56 

2.10 

0.30 

50658 

B 

0 

23 

46 

0.24 

0.21 

0.88 

-0.08 

50658 

C 

0 

8 

16 

0.40 

0.38 

1.04 

0.02 

50658 

D 

0 

10 

20 

-0.16 

0.47 

0.84 

-0.20 

50659 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

50659 

A 

1 

3 

6 

2.44 

1.69 

1.85 

0.42 

50659 

B 

0 

27 

54 

0.66 

0.13 

1.03 

0.05 

50659 

C 

0 

12 

24 

0.46 

0.28 

1.10 

-0.07 

50659 

D 

0 

8 

16 

-0.05 

0.36 

0.62 

-0.26 

50660 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50660 

A 

1 

11 

22 

1.18 

0.61 

3.31 

0.31 

50660 

B 

0 

31 

62 

0.36 

0.18 

1.01 

-0.02 

50660 

C 

0 

5 

10 

-0.73 

0.67 

0.66 

-0.26 

50660 

D 

0 

3 

6 

-0.58 

0.62 

0.36 

-0.17 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50661 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

50661 

A 

1 

41 

79 

0.47 

0.14 

0.95 

0.36 

50661 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50661 

C 

0 

4 

8 

-0.10 

0.46 

1.16 

-0.12 

50661 

D 

0 

7 

13 

-0.53 

0.34 

0.89 

-0.34 

50662 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50662 

A 

1 

42 

81 

0.81 

0.21 

0.97 

0.37 

50662 

B 

0 

6 

12 

0.15 

0.44 

1.73 

-0.11 

50662 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50662 

D 

0 

4 

8 

-1.43 

0.10 

0.22 

-0.42 

50663 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50663 

A 

1 

43 

90 

0.56 

0.18 

0.89 

0.40 

50663 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50663 

C 

0 

2 

4 

-1.05 

1.11 

0.71 

-0.23 

50663 

D 

0 

3 

6 

-1.15 

0.80 

0.73 

-0.31 

50664 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50664 

A 

1 

26 

51 

0.74 

0.25 

1.07 

0.32 

50664 

B 

0 

9 

18 

0.89 

0.57 

7.01 

0.20 

50664 

C 

0 

11 

22 

-0.47 

0.21 

0.68 

-0.28 

50664 

D 

0 

5 

10 

-1.43 

0.52 

0.30 

-0.40 

50665 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.02 

50665 

A 

1 

42 

81 

0.94 

0.22 

0.97 

0.34 

50665 

B 

0 

3 

6 

-0.12 

0.30 

0.78 

-0.15 

50665 

C 

0 

7 

13 

-0.29 

0.28 

0.80 

-0.29 

50665 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50666 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50666 

A 

1 

45 

92 

0.93 

0.21 

0.86 

0.37 

50666 

B 

0 

1 

2 

-0.19 

0.00 

0.78 

-0.09 

50666 

C 

0 

1 

2 

-0.80 

0.00 

0.42 

-0.16 

50666 

D 

0 

2 

4 

-1.62 

0.60 

0.22 

-0.34 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50667 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

50667 

A 

1 

27 

51 

0.77 

0.18 

0.88 

0.44 

50667 

B 

0 

12 

23 

0.05 

0.28 

1.25 

-0.14 

50667 

C 

0 

13 

25 

-0.21 

0.28 

1.00 

-0.29 

50667 

D 

0 

1 

2 

-1.72 

0.00 

0.13 

-0.27 

50668 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50668 

A 

1 

35 

70 

0.82 

0.17 

0.83 

0.59 

50668 

B 

0 

1 

2 

-2.14 

0.00 

0.10 

-0.33 

50668 

C 

0 

6 

12 

-0.44 

0.19 

0.60 

-0.28 

50668 

D 

0 

8 

16 

-0.53 

0.27 

0.64 

-0.36 

50669 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.05 

50669 

A 

1 

29 

62 

0.81 

0.19 

0.77 

0.64 

50669 

B 

0 

12 

26 

-0.59 

0.24 

0.66 

-0.41 

50669 

C 

0 

2 

4 

-0.94 

0.61 

0.43 

-0.21 

50669 

D 

0 

4 

9 

-1.04 

0.21 

0.35 

-0.33 

50670 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.06 

50670 

A 

1 

30 

63 

0.72 

0.23 

0.90 

0.54 

50670 

B 

0 

6 

13 

-0.68 

0.47 

0.84 

-0.23 

50670 

C 

0 

3 

6 

-0.98 

0.17 

0.41 

-0.22 

50670 

D 

0 

9 

19 

-0.80 

0.35 

0.78 

-0.34 

50671 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50671 

A 

1 

23 

45 

0.89 

0.24 

1.06 

0.38 

50671 

B 

0 

3 

6 

0.83 

0.34 

1.63 

0.09 

50671 

C 

0 

7 

14 

0.54 

0.34 

1.50 

0.03 

50671 

D 

0 

18 

35 

-0.18 

0.18 

0.76 

-0.46 

50672 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50672 

A 

1 

24 

48 

0.73 

0.14 

0.92 

0.49 

50672 

B 

0 

10 

20 

0.25 

0.16 

1.01 

-0.05 

50672 

C 

0 

12 

24 

-0.12 

0.22 

0.79 

-0.33 

50672 

D 

0 

4 

8 

-0.45 

0.27 

0.49 

-0.30 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50673 

* 

-1 

4480 

94 

0.88 

0.02 

0.00 

-0.07 

50673 

A 

1 

144 

51 

1.88 

0.10 

0.92 

0.51 

50673 

B 

0 

78 

28 

0.53 

0.10 

0.72 

-0.36 

50673 

C 

0 

55 

20 

0.81 

0.13 

1.02 

-0.18 

50673 

D 

0 

4 

1 

-0.80 

0.63 

0.22 

-0.20 

50674 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

50674 

A 

1 

10 

20 

1.11 

0.42 

1.19 

0.39 

50674 

B 

0 

20 

39 

0.37 

0.24 

1.40 

0.06 

50674 

C 

0 

15 

29 

-0.15 

0.14 

0.57 

-0.28 

50674 

D 

0 

6 

12 

-0.19 

0.25 

0.54 

-0.17 

50675 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50675 

A 

1 

18 

35 

1.34 

0.32 

1.18 

0.45 

50675 

B 

0 

10 

19 

-0.05 

0.37 

0.82 

-0.23 

50675 

C 

0 

13 

25 

-0.06 

0.21 

0.66 

-0.27 

50675 

D 

0 

11 

21 

0.52 

0.38 

1.48 

-0.01 

50676 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50676 

A 

1 

15 

31 

0.61 

0.37 

2.19 

0.09 

50676 

B 

0 

7 

14 

0.53 

0.27 

1.09 

0.02 

50676 

C 

0 

14 

29 

0.57 

0.27 

1.66 

0.06 

50676 

D 

0 

13 

27 

0.13 

0.37 

1.15 

-0.17 

50677 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50677 

A 

1 

35 

71 

0.41 

0.16 

1.17 

0.22 

50677 

B 

0 

2 

4 

-0.46 

0.92 

0.81 

-0.17 

50677 

C 

0 

7 

14 

-0.06 

0.34 

1.14 

-0.15 

50677 

D 

0 

5 

10 

0.16 

0.19 

1.10 

-0.05 

50678 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50678 

A 

1 

25 

52 

1.03 

0.23 

0.97 

0.43 

50678 

B 

0 

14 

29 

0.05 

0.20 

0.82 

-0.28 

50678 

C 

0 

7 

15 

0.44 

0.42 

1.65 

-0.04 

50678 

D 

0 

2 

4 

-1.35 

0.99 

0.25 

-0.34 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50679 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50679 

A 

1 

12 

24 

0.87 

0.33 

1.16 

0.30 

50679 

B 

0 

9 

18 

-0.30 

0.22 

0.54 

-0.28 

50679 

C 

0 

22 

45 

0.47 

0.21 

1.67 

0.14 

50679 

D 

0 

6 

12 

-0.48 

0.44 

0.60 

-0.28 

50680 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50680 

A 

1 

30 

61 

1.06 

0.23 

0.87 

0.51 

50680 

B 

0 

14 

29 

-0.08 

0.29 

1.15 

-0.27 

50680 

C 

0 

2 

4 

-0.65 

0.40 

0.42 

-0.18 

50680 

D 

0 

3 

6 

-1.51 

0.36 

0.19 

-0.38 

50681 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50681 

A 

1 

35 

70 

1.27 

0.22 

0.92 

0.54 

50681 

B 

0 

6 

12 

-1.60 

0.99 

0.41 

-0.49 

50681 

C 

0 

3 

6 

-0.27 

0.52 

0.60 

-0.14 

50681 

D 

0 

6 

12 

-0.10 

0.43 

0.88 

-0.17 

50682 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.01 

50682 

A 

1 

11 

23 

1.02 

0.42 

2.19 

0.11 

50682 

B 

0 

13 

27 

0.75 

0.27 

1.10 

-0.01 

50682 

C 

0 

10 

21 

1.18 

0.30 

1.69 

0.18 

50682 

D 

0 

14 

29 

0.33 

0.34 

1.00 

-0.25 

50683 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50683 

A 

1 

16 

33 

0.78 

0.34 

1.51 

0.33 

50683 

B 

0 

19 

39 

0.29 

0.19 

1.22 

-0.01 

50683 

C 

0 

5 

10 

-0.19 

0.30 

0.66 

-0.17 

50683 

D 

0 

9 

18 

-0.22 

0.12 

0.55 

-0.25 

50684 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50684 

A 

1 

19 

38 

1.17 

0.28 

1.13 

0.46 

50684 

B 

0 

13 

26 

0.36 

0.25 

1.14 

-0.05 

50684 

C 

0 

6 

12 

-0.56 

0.52 

0.50 

-0.31 

50684 

D 

0 

12 

24 

-0.04 

0.25 

0.69 

-0.24 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50685 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50685 

A 

1 

13 

27 

1.18 

0.45 

1.61 

0.29 

50685 

B 

0 

7 

15 

0.06 

0.38 

0.78 

-0.16 

50685 

C 

0 

7 

15 

-0.01 

0.55 

0.93 

-0.18 

50685 

D 

0 

21 

44 

0.52 

0.23 

1.28 

-0.02 

50686 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

50686 

A 

1 

28 

50 

1.04 

0.24 

1.23 

0.33 

50686 

B 

0 

3 

5 

-0.17 

0.71 

0.70 

-0.13 

50686 

C 

0 

11 

20 

0.39 

0.37 

1.48 

-0.07 

50686 

D 

0 

14 

25 

0.02 

0.39 

1.31 

-0.24 

50687 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.05 

50687 

A 

1 

30 

54 

0.79 

0.26 

1.19 

0.33 

50687 

B 

0 

5 

9 

-0.49 

0.27 

0.57 

-0.17 

50687 

C 

0 

9 

16 

0.27 

0.37 

2.19 

-0.02 

50687 

D 

0 

12 

21 

-0.40 

0.54 

1.42 

-0.26 

50688 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.03 

50688 

A 

1 

34 

62 

0.73 

0.21 

1.27 

0.29 

50688 

B 

0 

10 

18 

0.32 

0.25 

1.30 

-0.07 

50688 

C 

0 

2 

4 

-0.23 

0.68 

0.72 

-0.12 

50688 

D 

0 

9 

16 

-0.14 

0.23 

0.77 

-0.25 

50689 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50689 

A 

1 

19 

39 

0.79 

0.27 

1.21 

0.32 

50689 

B 

0 

11 

22 

0.04 

0.34 

1.42 

-0.13 

50689 

C 

0 

13 

27 

0.08 

0.30 

1.07 

-0.12 

50689 

D 

0 

6 

12 

-0.16 

0.53 

1.09 

-0.15 

50690 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50690 

A 

1 

25 

50 

1.30 

0.31 

1.18 

0.46 

50690 

B 

0 

10 

20 

-0.21 

0.34 

0.87 

-0.22 

50690 

C 

0 

9 

18 

0.22 

0.42 

1.59 

-0.09 

50690 

D 

0 

6 

12 

-0.94 

0.80 

0.59 

-0.33 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50691 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50691 

A 

1 

36 

68 

0.89 

0.19 

0.88 

0.43 

50691 

B 

0 

1 

2 

0.90 

0.00 

1.94 

0.04 

50691 

C 

0 

13 

25 

-0.02 

0.32 

1.62 

-0.21 

50691 

D 

0 

3 

6 

-2.32 

0.77 

0.12 

-0.50 

50692 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50692 

A 

1 

28 

54 

1.03 

0.20 

0.93 

0.46 

50692 

B 

0 

7 

13 

-0.47 

0.36 

0.54 

-0.37 

50692 

C 

0 

4 

8 

0.02 

0.62 

1.00 

-0.14 

50692 

D 

0 

13 

25 

0.29 

0.23 

1.08 

-0.15 

50693 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50693 

A 

1 

40 

77 

0.78 

0.15 

0.84 

0.47 

50693 

B 

0 

4 

8 

0.41 

0.49 

1.63 

-0.02 

50693 

C 

0 

3 

6 

-0.63 

0.33 

0.47 

-0.25 

50693 

D 

0 

5 

10 

-1.01 

0.46 

0.39 

-0.45 

50694 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50694 

A 

1 

29 

58 

0.47 

0.19 

1.28 

0.13 

50694 

B 

0 

4 

8 

-0.96 

0.63 

0.49 

-0.35 

50694 

C 

0 

13 

26 

0.72 

0.30 

2.35 

0.20 

50694 

D 

0 

4 

8 

-0.43 

0.48 

0.64 

-0.21 

50695 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50695 

A 

1 

6 

12 

1.51 

0.40 

0.79 

0.32 

50695 

B 

0 

8 

16 

0.31 

0.33 

0.76 

-0.01 

50695 

C 

0 

20 

40 

0.85 

0.30 

2.17 

0.30 

50695 

D 

0 

16 

32 

-0.70 

0.25 

0.29 

-0.53 

50696 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50696 

A 

1 

33 

66 

0.85 

0.22 

0.93 

0.47 

50696 

B 

0 

2 

4 

-0.18 

0.89 

1.02 

-0.10 

50696 

C 

0 

10 

20 

-0.38 

0.27 

0.83 

-0.32 

50696 

D 

0 

5 

10 

-0.51 

0.29 

0.58 

-0.25 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50697 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

50697 

A 

1 

30 

60 

1.22 

0.24 

0.84 

0.57 

50697 

B 

0 

3 

6 

-0.95 

0.52 

0.36 

-0.28 

50697 

C 

0 

16 

32 

-0.31 

0.22 

0.69 

-0.44 

50697 

D 

0 

1 

2 

0.28 

0.00 

0.93 

-0.03 

50698 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50698 

A 

1 

23 

46 

1.07 

0.18 

0.85 

0.51 

50698 

B 

0 

10 

20 

0.16 

0.16 

0.74 

-0.22 

50698 

C 

0 

9 

18 

0.12 

0.38 

1.36 

-0.23 

50698 

D 

0 

8 

16 

0.10 

0.22 

0.73 

-0.22 

50699 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.02 

50699 

A 

1 

19 

38 

1.37 

0.37 

1.54 

0.39 

50699 

B 

0 

5 

10 

-0.65 

0.45 

0.36 

-0.29 

50699 

C 

0 

23 

46 

0.57 

0.23 

1.30 

-0.04 

50699 

D 

0 

3 

6 

-1.41 

0.55 

0.15 

-0.35 

50700 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50700 

A 

1 

23 

43 

1.15 

0.26 

0.91 

0.50 

50700 

B 

0 

18 

34 

0.05 

0.20 

1.01 

-0.22 

50700 

C 

0 

6 

11 

-0.09 

0.70 

1.97 

-0.15 

50700 

D 

0 

6 

11 

-0.64 

0.18 

0.38 

-0.30 

50701 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50701 

A 

1 

18 

36 

0.81 

0.34 

1.32 

0.37 

50701 

B 

0 

20 

40 

0.05 

0.16 

1.00 

-0.14 

50701 

C 

0 

10 

20 

-0.18 

0.34 

1.04 

-0.18 

50701 

D 

0 

2 

4 

-0.90 

0.03 

0.31 

-0.20 

50702 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

-0.01 

50702 

A 

1 

39 

78 

1.26 

0.20 

0.95 

0.43 

50702 

B 

0 

11 

22 

-0.07 

0.30 

0.94 

-0.43 

50702 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50702 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg . Prsn Msr 

SE 

OUT.MSQ 

PTME 

50703 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50703 

A 

-1 

49 

100 

0.58 

0.19 

0.00 

0.00 

50703 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50703 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50703 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50704 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

50704 

A 

1 

27 

52 

0.80 

0.26 

1.57 

0.23 

50704 

B 

0 

18 

35 

0.34 

0.25 

1.70 

- 0.11 

50704 

C 

0 

5 

10 

0.31 

0.48 

1.31 

- 0.05 

50704 

D 

0 

2 

4 

- 1.08 

1.38 

0.47 

- 0.25 

50705 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50705 

A 

1 

37 

76 

1.18 

0.19 

0.88 

0.53 

50705 

B 

0 

1 

2 

- 1.32 

0.00 

0.18 

- 0.23 

50705 

C 

0 

10 

20 

- 0.41 

0.33 

0.71 

- 0.47 

50705 

D 

0 

1 

2 

0.41 

0.00 

1.01 

- 0.04 

50706 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50706 

A 

1 

15 

30 

1.30 

0.28 

0.91 

0.46 

50706 

B 

0 

33 

66 

0.12 

0.16 

0.82 

- 0.52 

50706 

C 

0 

2 

4 

1.51 

0.88 

3.12 

0.18 

50706 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50707 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50707 

A 

1 

20 

40 

0.90 

0.29 

1.50 

0.21 

50707 

B 

0 

14 

28 

0.45 

0.30 

1.37 

- 0.06 

50707 

C 

0 

16 

32 

0.27 

0.35 

1.54 

- 0.16 

50707 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50708 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50708 

A 

-1 

49 

100 

0.44 

0.20 

0.00 

0.00 

50708 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50708 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50708 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50709 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50709 

A 

1 

39 

80 

0.41 

0.22 

1.31 

0.10 

50709 

B 

0 

4 

8 

0.38 

0.48 

2.29 

0.01 

50709 

C 

0 

6 

12 

-0.08 

0.30 

1.18 

-0.13 

50709 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50710 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50710 

A 

1 

28 

57 

0.83 

0.18 

1.10 

0.31 

50710 

B 

0 

4 

8 

0.47 

0.18 

1.04 

-0.02 

50710 

C 

0 

16 

33 

0.24 

0.28 

1.32 

-0.21 

50710 

D 

0 

1 

2 

-2.07 

0.00 

0.08 

-0.36 

50711 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50711 

A 

1 

44 

88 

0.52 

0.17 

1.23 

0.14 

50711 

B 

0 

2 

4 

0.77 

0.31 

2.20 

0.06 

50711 

C 

0 

1 

2 

0.43 

0.00 

1.48 

-0.01 

50711 

D 

0 

3 

6 

-0.54 

0.27 

0.60 

-0.23 

50712 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50712 

A 

1 

46 

92 

0.49 

0.17 

0.93 

0.36 

50712 

B 

0 

2 

4 

-0.58 

0.74 

0.84 

-0.16 

50712 

C 

0 

1 

2 

-1.57 

0.00 

0.24 

-0.23 

50712 

D 

0 

1 

2 

-1.58 

0.00 

0.24 

-0.23 

50713 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50713 

A 

1 

23 

46 

0.89 

0.21 

0.83 

0.48 

50713 

B 

0 

25 

50 

-0.20 

0.23 

1.33 

-0.35 

50713 

C 

0 

1 

2 

-1.24 

0.00 

0.23 

-0.17 

50713 

D 

0 

1 

2 

-2.34 

0.00 

0.08 

-0.29 

50714 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50714 

A 

1 

44 

90 

0.24 

0.17 

0.96 

0.27 

50714 

B 

0 

2 

4 

0.08 

0.32 

1.51 

-0.01 

50714 

C 

0 

1 

2 

-1.49 

0.00 

0.30 

-0.21 

50714 

D 

0 

2 

4 

-1.21 

1.13 

0.68 

-0.25 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50715 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50715 

A 

1 

45 

90 

0.35 

0.23 

2.00 

0.31 

50715 

B 

0 

3 

6 

-0.83 

0.77 

1.33 

-0.16 

50715 

C 

0 

1 

2 

-1.46 

0.00 

0.42 

-0.15 

50715 

D 

0 

1 

2 

-2.34 

0.00 

0.17 

-0.23 

50716 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50716 

A 

1 

40 

82 

0.53 

0.23 

1.06 

0.27 

50716 

B 

0 

7 

14 

-0.33 

0.72 

3.65 

-0.18 

50716 

C 

0 

2 

4 

-1.22 

0.32 

0.41 

-0.21 

50716 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50717 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50717 

A 

1 

44 

92 

0.67 

0.15 

0.88 

0.35 

50717 

B 

0 

3 

6 

-0.16 

0.43 

0.88 

-0.17 

50717 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50717 

D 

0 

1 

2 

-2.31 

0.00 

0.09 

-0.39 

50718 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

50718 

A 

1 

46 

96 

0.70 

0.21 

1.02 

0.21 

50718 

B 

0 

1 

2 

-0.49 

0.00 

0.69 

-0.12 

50718 

C 

0 

1 

2 

-0.95 

0.00 

0.43 

-0.17 

50718 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50719 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50719 

A 

-1 

50 

100 

0.41 

0.17 

0.00 

0.00 

50719 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50719 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50719 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50720 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50720 

A 

1 

48 

96 

0.49 

0.17 

0.94 

0.30 

50720 

B 

0 

1 

2 

-1.14 

0.00 

0.37 

-0.18 

50720 

C 

0 

1 

2 

-1.64 

0.00 

0.22 

-0.24 

50720 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg . Prsn Msr 

SE 

OUT.MSQ 

PTME 

50721 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50721 

A 

1 

45 

94 

0.60 

0.22 

0.91 

0.23 

50721 

B 

0 

2 

4 

- 1.66 

0.89 

0.34 

- 0.30 

50721 

C 

0 

1 

2 

0.92 

0.00 

3.20 

0.04 

50721 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50722 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

50722 

A 

1 

47 

94 

0.43 

0.16 

1.02 

0.12 

50722 

B 

0 

1 

2 

- 1.70 

0.00 

0.20 

- 0.28 

50722 

C 

0 

2 

4 

0.67 

0.49 

2.34 

0.05 

50722 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50723 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50723 

A 

1 

45 

94 

0.51 

0.17 

0.87 

0.35 

50723 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50723 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50723 

D 

0 

3 

6 

- 1.25 

0.80 

0.61 

- 0.35 

50724 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.06 

50724 

A 

1 

47 

98 

0.14 

0.21 

1.14 

0.13 

50724 

B 

0 

1 

2 

- 1.10 

0.00 

0.72 

- 0.13 

50724 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50724 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50725 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50725 

A 

1 

46 

94 

0.14 

0.18 

0.96 

0.26 

50725 

B 

0 

2 

4 

- 0.66 

0.16 

0.84 

- 0.12 

50725 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50725 

D 

0 

1 

2 

- 2.31 

0.00 

0.16 

- 0.28 

50726 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50726 

A 

1 

47 

96 

0.27 

0.19 

1.15 

0.13 

50726 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50726 

C 

0 

1 

2 

- 0.41 

0.00 

1.07 

- 0.07 

50726 

D 

0 

1 

2 

- 0.69 

0.00 

0.81 

- 0.10 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50727 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.01 

50727 

A 

1 

45 

94 

0.91 

0.18 

0.95 

0.31 

50727 

B 

0 

1 

2 

-0.52 

0.00 

0.46 

-0.16 

50727 

C 

0 

1 

2 

-0.22 

0.00 

0.63 

-0.12 

50727 

D 

0 

1 

2 

-1.27 

0.00 

0.22 

-0.24 

50728 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50728 

A 

1 

43 

88 

0.67 

0.17 

1.24 

0.41 

50728 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50728 

C 

0 

5 

10 

-0.83 

0.44 

0.66 

-0.37 

50728 

D 

0 

1 

2 

-0.90 

0.00 

0.42 

-0.17 

50729 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50729 

A 

1 

30 

63 

0.85 

0.20 

1.06 

0.39 

50729 

B 

0 

8 

17 

0.06 

0.35 

0.99 

-0.18 

50729 

C 

0 

6 

13 

-0.51 

0.26 

0.49 

-0.35 

50729 

D 

0 

4 

8 

0.45 

0.41 

1.48 

-0.02 

50730 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50730 

A 

1 

35 

71 

0.93 

0.18 

0.81 

0.52 

50730 

B 

0 

3 

6 

-0.73 

0.41 

0.43 

-0.28 

50730 

C 

0 

10 

20 

-0.25 

0.28 

0.78 

-0.34 

50730 

D 

0 

1 

2 

-1.15 

0.00 

0.24 

-0.21 

50731 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.04 

50731 

A 

1 

37 

79 

0.58 

0.15 

0.98 

0.32 

50731 

B 

0 

2 

4 

-0.63 

0.58 

0.56 

-0.20 

50731 

C 

0 

6 

13 

0.15 

0.65 

3.70 

-0.09 

50731 

D 

0 

2 

4 

-1.10 

0.65 

0.37 

-0.30 

50732 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50732 

A 

1 

38 

78 

0.41 

0.21 

1.24 

0.42 

50732 

B 

0 

3 

6 

-1.17 

0.56 

0.57 

-0.25 

50732 

C 

0 

4 

8 

-0.50 

0.52 

1.12 

-0.14 

50732 

D 

0 

4 

8 

-1.13 

0.31 

0.50 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50733 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50733 

A 

1 

26 

54 

0.85 

0.19 

0.92 

0.42 

50733 

B 

0 

7 

15 

0.09 

0.41 

1.38 

-0.12 

50733 

C 

0 

8 

17 

0.11 

0.41 

1.19 

-0.13 

50733 

D 

0 

7 

15 

-0.45 

0.39 

0.64 

-0.33 

50734 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50734 

A 

1 

35 

71 

0.81 

0.22 

1.47 

0.44 

50734 

B 

0 

3 

6 

-1.00 

0.57 

0.41 

-0.28 

50734 

C 

0 

1 

2 

-1.14 

0.00 

0.28 

-0.17 

50734 

D 

0 

10 

20 

-0.25 

0.27 

0.95 

-0.26 

50735 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50735 

A 

1 

34 

71 

0.50 

0.25 

1.12 

0.26 

50735 

B 

0 

3 

6 

-0.07 

0.21 

1.07 

-0.07 

50735 

C 

0 

7 

15 

0.10 

0.25 

1.48 

-0.06 

50735 

D 

0 

4 

8 

-1.03 

0.52 

0.63 

-0.30 

50736 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.07 

50736 

A 

1 

46 

96 

0.02 

0.17 

1.01 

0.32 

50736 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50736 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50736 

D 

0 

2 

4 

-1.81 

0.13 

0.32 

-0.32 

50737 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.04 

50737 

A 

1 

5 

11 

1.48 

0.42 

0.73 

0.33 

50737 

B 

0 

37 

79 

0.17 

0.20 

0.95 

-0.23 

50737 

C 

0 

1 

2 

-0.45 

0.00 

0.28 

-0.09 

50737 

D 

0 

4 

9 

0.42 

0.65 

1.21 

0.03 

50738 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50738 

A 

1 

33 

69 

0.81 

0.19 

0.87 

0.58 

50738 

B 

0 

7 

15 

-0.80 

0.47 

0.82 

-0.33 

50738 

C 

0 

4 

8 

-0.51 

0.24 

0.61 

-0.17 

50738 

D 

0 

4 

8 

-1.43 

0.92 

0.52 

-0.38 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50739 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50739 

A 

1 

43 

88 

0.44 

0.18 

0.94 

0.40 

50739 

B 

0 

1 

2 

-1.85 

0.00 

0.20 

-0.25 

50739 

C 

0 

1 

2 

-1.37 

0.00 

0.32 

-0.19 

50739 

D 

0 

4 

8 

-0.76 

0.50 

0.77 

-0.25 

50740 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50740 

A 

1 

38 

79 

0.50 

0.21 

1.11 

0.27 

50740 

B 

0 

6 

13 

0.30 

0.40 

2.08 

0.00 

50740 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50740 

D 

0 

4 

8 

-1.42 

0.71 

0.44 

-0.39 

50741 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50741 

A 

1 

33 

69 

0.60 

0.22 

1.04 

0.42 

50741 

B 

0 

7 

15 

-0.16 

0.35 

1.11 

-0.14 

50741 

C 

0 

7 

15 

-0.72 

0.28 

0.63 

-0.32 

50741 

D 

0 

1 

2 

-1.54 

0.00 

0.22 

-0.21 

50742 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50742 

A 

1 

42 

86 

0.41 

0.17 

1.11 

0.23 

50742 

B 

0 

1 

2 

-0.38 

0.00 

0.76 

-0.08 

50742 

C 

0 

1 

2 

1.66 

0.00 

5.82 

0.17 

50742 

D 

0 

5 

10 

-0.76 

0.73 

1.03 

-0.31 

50743 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50743 

A 

1 

42 

86 

0.55 

0.19 

1.10 

0.15 

50743 

B 

0 

3 

6 

-0.24 

0.82 

1.43 

-0.15 

50743 

C 

0 

3 

6 

0.35 

0.13 

1.35 

-0.03 

50743 

D 

0 

1 

2 

-0.06 

0.00 

0.89 

-0.07 

50744 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50744 

A 

1 

22 

46 

0.89 

0.20 

0.90 

0.50 

50744 

B 

0 

23 

48 

-0.12 

0.15 

0.79 

-0.51 

50744 

C 

0 

2 

4 

0.32 

0.17 

0.94 

-0.01 

50744 

D 

0 

1 

2 

0.77 

0.00 

1.46 

0.06 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50745 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50745 

A 

1 

29 

59 

0.71 

0.18 

0.96 

0.43 

50745 

B 

0 

1 

2 

-1.41 

0.00 

0.19 

-0.26 

50745 

C 

0 

16 

33 

-0.05 

0.22 

1.04 

-0.30 

50745 

D 

0 

3 

6 

-0.13 

0.09 

0.67 

-0.13 

50746 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50746 

A 

1 

27 

55 

1.08 

0.23 

0.87 

0.59 

50746 

B 

0 

12 

24 

-0.18 

0.24 

0.88 

-0.28 

50746 

C 

0 

3 

6 

-0.82 

0.39 

0.38 

-0.26 

50746 

D 

0 

7 

14 

-0.52 

0.23 

0.51 

-0.31 

50747 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

50747 

A 

1 

34 

68 

0.57 

0.22 

1.21 

0.35 

50747 

B 

0 

9 

18 

-0.53 

0.29 

0.80 

-0.30 

50747 

C 

0 

5 

10 

-0.04 

0.41 

1.28 

-0.08 

50747 

D 

0 

2 

4 

-0.42 

1.22 

1.20 

-0.11 

50748 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50748 

A 

1 

35 

71 

0.88 

0.19 

0.95 

0.51 

50748 

B 

0 

7 

14 

-0.74 

0.21 

0.43 

-0.42 

50748 

C 

0 

7 

14 

-0.18 

0.40 

1.00 

-0.23 

50748 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50749 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50749 

A 

1 

36 

73 

1.01 

0.23 

1.10 

0.42 

50749 

B 

0 

6 

12 

-0.52 

0.42 

0.64 

-0.31 

50749 

C 

0 

3 

6 

-0.17 

0.40 

0.76 

-0.15 

50749 

D 

0 

4 

8 

-0.14 

0.51 

0.96 

-0.17 

50750 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50750 

A 

1 

8 

16 

0.96 

0.28 

1.06 

0.22 

50750 

B 

0 

6 

12 

0.39 

0.43 

1.04 

-0.03 

50750 

C 

0 

25 

51 

0.35 

0.15 

0.88 

-0.13 

50750 

D 

0 

10 

20 

0.42 

0.49 

1.98 

-0.03 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50751 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50751 

A 

1 

12 

25 

0.87 

0.48 

1.61 

0.24 

50751 

B 

0 

16 

33 

-0.15 

0.25 

0.75 

-0.21 

50751 

C 

0 

10 

21 

0.11 

0.50 

1.51 

-0.06 

50751 

D 

0 

10 

21 

0.39 

0.50 

2.07 

0.04 

50752 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50752 

A 

1 

10 

20 

0.87 

0.36 

1.53 

0.21 

50752 

B 

0 

13 

27 

0.70 

0.25 

1.45 

0.14 

50752 

C 

0 

10 

20 

0.22 

0.31 

0.98 

-0.12 

50752 

D 

0 

16 

33 

0.16 

0.25 

0.91 

-0.21 

50753 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50753 

A 

1 

10 

20 

0.74 

0.57 

2.43 

0.15 

50753 

B 

0 

30 

61 

0.35 

0.22 

1.41 

0.00 

50753 

C 

0 

2 

4 

1.08 

0.25 

1.61 

0.12 

50753 

D 

0 

7 

14 

-0.45 

0.38 

0.52 

-0.24 

50754 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50754 

A 

1 

16 

33 

0.96 

0.29 

1.21 

0.27 

50754 

B 

0 

29 

60 

0.38 

0.20 

1.24 

-0.11 

50754 

C 

0 

1 

2 

-0.45 

0.00 

0.32 

-0.11 

50754 

D 

0 

2 

4 

-1.09 

2.02 

0.64 

-0.27 

50755 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50755 

A 

1 

11 

22 

1.46 

0.64 

2.46 

0.34 

50755 

B 

0 

31 

63 

0.52 

0.21 

1.63 

0.08 

50755 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50755 

D 

0 

7 

14 

-1.66 

0.34 

0.12 

-0.51 

50756 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50756 

A 

1 

14 

29 

1.59 

0.27 

0.55 

0.61 

50756 

B 

0 

5 

10 

-0.10 

0.54 

0.80 

-0.12 

50756 

C 

0 

13 

27 

-0.19 

0.25 

0.60 

-0.25 

50756 

D 

0 

16 

33 

-0.17 

0.30 

0.83 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50757 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50757 

A 

1 

6 

13 

1.67 

0.94 

2.95 

0.32 

50757 

B 

0 

25 

52 

0.79 

0.25 

1.62 

0.28 

50757 

C 

0 

5 

10 

-0.92 

0.48 

0.26 

-0.29 

50757 

D 

0 

12 

25 

-0.57 

0.30 

0.40 

-0.36 

50758 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50758 

A 

1 

24 

49 

0.93 

0.23 

1.09 

0.43 

50758 

B 

0 

2 

4 

-0.67 

1.05 

0.53 

-0.14 

50758 

C 

0 

4 

8 

0.01 

0.37 

0.80 

-0.06 

50758 

D 

0 

19 

39 

-0.30 

0.37 

0.84 

-0.35 

50759 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50759 

A 

1 

22 

46 

0.69 

0.19 

0.84 

0.45 

50759 

B 

0 

6 

13 

-0.06 

0.31 

0.96 

-0.09 

50759 

C 

0 

5 

10 

-0.20 

0.43 

0.89 

-0.13 

50759 

D 

0 

15 

31 

-0.30 

0.28 

1.06 

-0.33 

50760 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50760 

A 

1 

5 

10 

0.66 

0.53 

1.86 

0.09 

50760 

B 

0 

28 

58 

0.50 

0.17 

1.13 

0.11 

50760 

C 

0 

3 

6 

-0.92 

0.42 

0.22 

-0.33 

50760 

D 

0 

12 

25 

0.39 

0.35 

1.16 

0.00 

50761 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50761 

A 

1 

29 

60 

1.14 

0.26 

0.67 

0.63 

50761 

B 

0 

3 

6 

-0.08 

0.32 

1.01 

-0.08 

50761 

C 

0 

10 

21 

-1.00 

0.24 

0.49 

-0.46 

50761 

D 

0 

6 

13 

-0.90 

0.42 

0.55 

-0.31 

50762 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50762 

A 

1 

22 

46 

1.45 

0.31 

1.38 

0.64 

50762 

B 

0 

6 

13 

-0.37 

0.48 

0.74 

-0.20 

50762 

C 

0 

8 

17 

-0.23 

0.20 

0.63 

-0.19 

50762 

D 

0 

12 

25 

-0.70 

0.23 

0.44 

-0.43 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50763 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.04 

50763 

A 

1 

37 

73 

0.73 

0.17 

0.82 

0.46 

50763 

B 

0 

3 

6 

-0.80 

0.30 

0.43 

-0.25 

50763 

C 

0 

6 

12 

0.08 

0.63 

2.62 

-0.10 

50763 

D 

0 

5 

10 

-0.96 

0.35 

0.44 

-0.38 

50764 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50764 

A 

1 

32 

65 

1.06 

0.21 

0.78 

0.57 

50764 

B 

0 

7 

14 

-0.67 

0.39 

0.64 

-0.33 

50764 

C 

0 

6 

12 

-0.39 

0.63 

1.59 

-0.23 

50764 

D 

0 

4 

8 

-0.95 

0.44 

0.43 

-0.30 

50765 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50765 

A 

1 

29 

60 

0.80 

0.18 

0.73 

0.64 

50765 

B 

0 

3 

6 

-0.94 

0.35 

0.42 

-0.26 

50765 

C 

0 

6 

13 

-0.90 

0.26 

0.44 

-0.37 

50765 

D 

0 

10 

21 

-0.49 

0.26 

0.79 

-0.32 

50766 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.04 

50766 

A 

1 

34 

72 

0.94 

0.20 

0.81 

0.64 

50766 

B 

0 

2 

4 

-2.24 

0.08 

0.10 

-0.40 

50766 

C 

0 

7 

15 

-0.79 

0.15 

0.46 

-0.36 

50766 

D 

0 

4 

9 

-0.82 

0.47 

0.54 

-0.27 

50767 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50767 

A 

1 

33 

67 

0.73 

0.18 

0.81 

0.58 

50767 

B 

0 

5 

10 

-0.65 

0.21 

0.52 

-0.29 

50767 

C 

0 

6 

12 

-0.60 

0.34 

0.68 

-0.31 

50767 

D 

0 

5 

10 

-0.55 

0.20 

0.56 

-0.26 

50768 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50768 

A 

1 

37 

76 

0.55 

0.19 

1.01 

0.41 

50768 

B 

0 

3 

6 

-0.57 

0.56 

0.78 

-0.18 

50768 

C 

0 

5 

10 

-0.52 

0.72 

1.35 

-0.22 

50768 

D 

0 

4 

8 

-0.70 

0.29 

0.58 

-0.24 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50769 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50769 

A 

1 

33 

67 

0.93 

0.18 

0.73 

0.58 

50769 

B 

0 

6 

12 

-0.19 

0.60 

1.84 

-0.18 

50769 

C 

0 

2 

4 

-1.93 

0.43 

0.13 

-0.38 

50769 

D 

0 

8 

16 

-0.71 

0.27 

0.54 

-0.38 

50770 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50770 

A 

1 

19 

40 

1.17 

0.25 

0.72 

0.60 

50770 

B 

0 

6 

13 

-0.60 

0.40 

0.62 

-0.26 

50770 

C 

0 

21 

44 

-0.32 

0.22 

0.78 

-0.40 

50770 

D 

0 

2 

4 

-0.01 

0.54 

0.79 

-0.04 

50771 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50771 

A 

1 

37 

77 

0.47 

0.21 

0.97 

0.38 

50771 

B 

0 

4 

8 

-0.40 

0.56 

1.17 

-0.14 

50771 

C 

0 

4 

8 

-1.20 

0.49 

0.51 

-0.32 

50771 

D 

0 

3 

6 

-0.48 

0.23 

0.80 

-0.14 

50772 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50772 

A 

1 

32 

65 

0.49 

0.20 

1.02 

0.42 

50772 

B 

0 

2 

4 

-1.39 

0.94 

0.40 

-0.26 

50772 

C 

0 

12 

24 

-0.35 

0.29 

1.18 

-0.22 

50772 

D 

0 

3 

6 

-0.91 

0.47 

0.54 

-0.22 

50773 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50773 

A 

1 

40 

82 

0.62 

0.18 

0.99 

0.42 

50773 

B 

0 

5 

10 

-0.37 

0.34 

0.86 

-0.21 

50773 

C 

0 

3 

6 

-0.94 

0.74 

0.58 

-0.28 

50773 

D 

0 

1 

2 

-1.41 

0.00 

0.24 

-0.21 

50774 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50774 

A 

1 

42 

88 

0.34 

0.16 

0.86 

0.39 

50774 

B 

0 

1 

2 

-0.02 

0.00 

1.22 

-0.03 

50774 

C 

0 

5 

10 

-1.16 

0.50 

0.65 

-0.41 

50774 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50775 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50775 

A 

1 

17 

35 

1.06 

0.41 

1.78 

0.40 

50775 

B 

0 

15 

31 

0.22 

0.20 

1.02 

-0.07 

50775 

C 

0 

3 

6 

-0.99 

0.49 

0.32 

-0.27 

50775 

D 

0 

14 

29 

-0.06 

0.22 

0.88 

-0.21 

50776 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50776 

A 

1 

16 

33 

0.85 

0.22 

1.06 

0.33 

50776 

B 

0 

9 

19 

0.00 

0.21 

0.69 

-0.26 

50776 

C 

0 

16 

33 

0.56 

0.22 

1.35 

0.08 

50776 

D 

0 

7 

15 

-0.07 

0.19 

0.60 

-0.26 

50777 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50777 

A 

1 

28 

53 

1.01 

0.23 

1.12 

0.49 

50777 

B 

0 

10 

19 

-0.23 

0.20 

0.64 

-0.28 

50777 

C 

0 

7 

13 

0.36 

0.38 

1.50 

-0.03 

50777 

D 

0 

8 

15 

-0.52 

0.27 

0.50 

-0.35 

50778 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50778 

A 

1 

14 

29 

1.43 

0.31 

0.88 

0.49 

50778 

B 

0 

9 

19 

0.51 

0.47 

1.88 

0.04 

50778 

C 

0 

9 

19 

-0.19 

0.49 

1.09 

-0.20 

50778 

D 

0 

16 

33 

-0.26 

0.25 

0.59 

-0.34 

50779 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

50779 

A 

1 

23 

43 

1.16 

0.30 

0.93 

0.51 

50779 

B 

0 

8 

15 

-0.51 

0.19 

0.50 

-0.31 

50779 

C 

0 

11 

21 

0.50 

0.17 

1.37 

0.03 

50779 

D 

0 

11 

21 

-0.52 

0.22 

0.52 

-0.38 

50780 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50780 

A 

1 

24 

49 

0.90 

0.22 

1.01 

0.49 

50780 

B 

0 

11 

22 

-0.04 

0.32 

1.42 

-0.14 

50780 

C 

0 

8 

16 

-0.48 

0.44 

1.03 

-0.27 

50780 

D 

0 

6 

12 

-0.61 

0.43 

0.58 

-0.27 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50781 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

-0.01 

50781 

A 

1 

27 

55 

1.53 

0.26 

1.00 

0.45 

50781 

B 

0 

6 

12 

0.29 

0.42 

0.93 

-0.22 

50781 

C 

0 

3 

6 

0.76 

0.64 

1.33 

-0.05 

50781 

D 

0 

13 

27 

0.35 

0.20 

0.82 

-0.32 

50782 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.07 

50782 

A 

1 

28 

58 

0.41 

0.22 

0.98 

0.45 

50782 

B 

0 

10 

21 

-0.17 

0.25 

1.24 

-0.06 

50782 

C 

0 

6 

13 

-1.38 

0.38 

0.40 

-0.43 

50782 

D 

0 

4 

8 

-0.78 

0.25 

0.58 

-0.19 

50783 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50783 

A 

1 

31 

63 

0.51 

0.22 

1.05 

0.47 

50783 

B 

0 

9 

18 

-0.97 

0.26 

0.53 

-0.40 

50783 

C 

0 

3 

6 

0.49 

0.40 

2.14 

0.09 

50783 

D 

0 

6 

12 

-0.89 

0.19 

0.51 

-0.29 

50784 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.02 

50784 

A 

1 

35 

73 

1.03 

0.24 

0.84 

0.52 

50784 

B 

0 

9 

19 

-0.64 

0.23 

0.58 

-0.40 

50784 

C 

0 

1 

2 

-0.25 

0.00 

0.69 

-0.08 

50784 

D 

0 

3 

6 

-0.93 

0.60 

0.48 

-0.26 

50785 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50785 

A 

1 

31 

63 

0.82 

0.17 

0.70 

0.66 

50785 

B 

0 

4 

8 

-1.04 

0.49 

0.44 

-0.32 

50785 

C 

0 

5 

10 

-0.99 

0.40 

0.43 

-0.35 

50785 

D 

0 

9 

18 

-0.58 

0.23 

0.63 

-0.32 

50786 

* 

-1 

4488 

94 

0.86 

0.02 

0.00 

-0.14 

50786 

A 

1 

197 

72 

2.12 

0.08 

0.81 

0.54 

50786 

B 

0 

26 

10 

0.67 

0.19 

0.83 

-0.25 

50786 

C 

0 

39 

14 

0.59 

0.17 

0.67 

-0.33 

50786 

D 

0 

11 

4 

-0.10 

0.18 

0.28 

-0.27 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50787 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50787 

A 

1 

23 

47 

1.26 

0.18 

0.66 

0.66 

50787 

B 

0 

10 

20 

-0.15 

0.19 

0.60 

-0.31 

50787 

C 

0 

12 

24 

0.03 

0.18 

0.72 

-0.25 

50787 

D 

0 

4 

8 

-0.69 

0.75 

0.56 

-0.33 

50788 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50788 

A 

1 

20 

41 

0.90 

0.22 

0.74 

0.57 

50788 

B 

0 

9 

18 

-0.42 

0.37 

0.88 

-0.19 

50788 

C 

0 

6 

12 

-0.38 

0.31 

0.74 

-0.14 

50788 

D 

0 

14 

29 

-0.60 

0.29 

0.83 

-0.36 

50789 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50789 

A 

1 

16 

33 

0.67 

0.27 

1.46 

0.25 

50789 

B 

0 

10 

20 

0.70 

0.31 

1.98 

0.20 

50789 

C 

0 

7 

14 

-0.03 

0.34 

0.91 

-0.12 

50789 

D 

0 

16 

33 

-0.23 

0.24 

0.67 

-0.34 

50790 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.06 

50790 

A 

1 

28 

58 

0.79 

0.27 

0.79 

0.57 

50790 

B 

0 

6 

13 

-0.87 

0.46 

0.74 

-0.25 

50790 

C 

0 

6 

13 

-0.74 

0.31 

0.72 

-0.22 

50790 

D 

0 

8 

17 

-0.97 

0.26 

0.56 

-0.33 

50791 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

50791 

A 

1 

43 

81 

0.76 

0.18 

1.05 

0.45 

50791 

B 

0 

2 

4 

-0.48 

0.89 

0.83 

-0.15 

50791 

C 

0 

3 

6 

-0.65 

0.31 

0.54 

-0.22 

50791 

D 

0 

5 

9 

-0.78 

0.62 

1.18 

-0.33 

50792 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50792 

A 

1 

34 

71 

0.80 

0.22 

0.94 

0.42 

50792 

B 

0 

2 

4 

-0.09 

0.32 

0.83 

-0.09 

50792 

C 

0 

10 

21 

-0.31 

0.30 

0.89 

-0.31 

50792 

D 

0 

2 

4 

-0.87 

0.12 

0.36 

-0.22 



easyCBM CCSS Fifth Grade Math Measure Development 


354 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50793 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50793 

A 

1 

34 

69 

0.77 

0.23 

1.26 

0.42 

50793 

B 

0 

8 

16 

-0.37 

0.34 

0.80 

-0.26 

50793 

C 

0 

6 

12 

-0.38 

0.41 

0.91 

-0.22 

50793 

D 

0 

1 

2 

-1.16 

0.00 

0.27 

-0.17 

50794 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50794 

A 

1 

35 

73 

0.61 

0.21 

1.21 

0.37 

50794 

B 

0 

5 

10 

-0.40 

0.23 

0.73 

-0.20 

50794 

C 

0 

6 

13 

0.04 

0.37 

1.42 

-0.09 

50794 

D 

0 

2 

4 

-1.99 

0.43 

0.15 

-0.39 

50795 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50795 

A 

1 

31 

65 

0.92 

0.20 

0.63 

0.68 

50795 

B 

0 

8 

17 

-0.90 

0.30 

0.52 

-0.37 

50795 

C 

0 

7 

15 

-0.97 

0.33 

0.49 

-0.37 

50795 

D 

0 

2 

4 

-1.68 

0.53 

0.21 

-0.29 

50796 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50796 

A 

1 

30 

61 

0.98 

0.21 

1.22 

0.46 

50796 

B 

0 

14 

29 

-0.04 

0.25 

1.08 

-0.32 

50796 

C 

0 

3 

6 

-0.15 

0.32 

0.65 

-0.15 

50796 

D 

0 

2 

4 

-0.68 

0.92 

0.50 

-0.22 

50797 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50797 

A 

1 

35 

73 

0.71 

0.18 

0.84 

0.57 

50797 

B 

0 

8 

17 

-0.90 

0.28 

0.54 

-0.37 

50797 

C 

0 

3 

6 

-0.43 

0.61 

0.91 

-0.13 

50797 

D 

0 

2 

4 

-2.53 

2.08 

0.33 

-0.42 

50798 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50798 

A 

1 

26 

54 

0.83 

0.20 

0.94 

0.44 

50798 

B 

0 

5 

10 

-0.59 

0.49 

0.58 

-0.30 

50798 

C 

0 

12 

25 

0.34 

0.24 

1.39 

-0.02 

50798 

D 

0 

5 

10 

-0.95 

0.29 

0.33 

-0.41 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50799 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50799 

A 

1 

32 

65 

0.67 

0.22 

0.90 

0.49 

50799 

B 

0 

3 

6 

-1.58 

0.50 

0.27 

-0.34 

50799 

C 

0 

10 

20 

-0.24 

0.31 

1.09 

-0.17 

50799 

D 

0 

4 

8 

-1.13 

0.08 

0.34 

-0.30 

50800 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

50800 

A 

1 

37 

71 

0.73 

0.22 

1.09 

0.38 

50800 

B 

0 

6 

12 

0.05 

0.31 

1.22 

-0.11 

50800 

C 

0 

6 

12 

-0.26 

0.33 

0.89 

-0.19 

50800 

D 

0 

3 

6 

-1.22 

0.15 

0.28 

-0.32 

50801 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50801 

A 

1 

9 

19 

1.12 

0.63 

2.26 

0.37 

50801 

B 

0 

7 

15 

0.12 

0.20 

0.72 

-0.03 

50801 

C 

0 

19 

40 

0.10 

0.21 

0.97 

-0.07 

50801 

D 

0 

13 

27 

-0.24 

0.27 

0.68 

-0.23 

50802 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.06 

50802 

A 

1 

16 

33 

0.68 

0.35 

1.78 

0.36 

50802 

B 

0 

6 

13 

-1.00 

0.37 

0.37 

-0.33 

50802 

C 

0 

14 

29 

0.09 

0.19 

1.01 

0.01 

50802 

D 

0 

12 

25 

-0.25 

0.34 

1.02 

-0.15 

50803 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50803 

A 

1 

20 

41 

0.85 

0.28 

1.15 

0.39 

50803 

B 

0 

8 

16 

-1.06 

0.40 

0.42 

-0.38 

50803 

C 

0 

7 

14 

-0.17 

0.70 

1.29 

-0.10 

50803 

D 

0 

14 

29 

0.10 

0.32 

1.49 

-0.03 

50804 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.01 

50804 

A 

1 

26 

51 

1.37 

0.28 

0.98 

0.48 

50804 

B 

0 

3 

6 

-0.21 

0.36 

0.51 

-0.18 

50804 

C 

0 

11 

22 

0.21 

0.30 

1.01 

-0.21 

50804 

D 

0 

11 

22 

0.01 

0.31 

0.81 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50805 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50805 

A 

1 

24 

49 

0.97 

0.29 

1.52 

0.28 

50805 

B 

0 

9 

18 

0.61 

0.35 

1.59 

-0.01 

50805 

C 

0 

6 

12 

-0.11 

0.38 

0.66 

-0.23 

50805 

D 

0 

10 

20 

0.26 

0.24 

0.93 

-0.16 

50806 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.06 

50806 

A 

1 

8 

17 

0.41 

0.55 

2.18 

0.13 

50806 

B 

0 

18 

38 

0.01 

0.15 

0.79 

-0.09 

50806 

C 

0 

2 

4 

0.28 

1.88 

2.95 

0.03 

50806 

D 

0 

19 

40 

0.09 

0.21 

0.97 

-0.03 

50807 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50807 

A 

1 

18 

38 

1.40 

0.28 

0.87 

0.62 

50807 

B 

0 

16 

33 

-0.10 

0.18 

0.69 

-0.31 

50807 

C 

0 

2 

4 

-0.74 

0.80 

0.37 

-0.20 

50807 

D 

0 

12 

25 

-0.10 

0.25 

0.70 

-0.26 

50808 

* 

-1 

4508 

95 

0.88 

0.02 

0.00 

-0.08 

50808 

A 

1 

167 

66 

1.79 

0.08 

0.90 

0.53 

50808 

B 

0 

56 

22 

0.63 

0.09 

0.73 

-0.32 

50808 

C 

0 

18 

7 

0.59 

0.12 

0.64 

-0.18 

50808 

D 

0 

12 

5 

-0.41 

0.47 

0.47 

-0.33 

50809 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.04 

50809 

A 

1 

17 

36 

1.47 

0.37 

0.84 

0.59 

50809 

B 

0 

9 

19 

-0.59 

0.28 

0.51 

-0.33 

50809 

C 

0 

8 

17 

-0.27 

0.29 

0.69 

-0.21 

50809 

D 

0 

13 

28 

-0.01 

0.26 

0.94 

-0.17 

50810 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50810 

A 

1 

19 

39 

1.13 

0.31 

1.25 

0.35 

50810 

B 

0 

6 

12 

0.09 

0.33 

0.73 

-0.19 

50810 

C 

0 

11 

22 

0.36 

0.27 

1.01 

-0.14 

50810 

D 

0 

13 

27 

0.44 

0.23 

1.06 

-0.11 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50811 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50811 

A 

1 

46 

94 

0.76 

0.18 

0.87 

0.38 

50811 

B 

0 

2 

4 

-1.42 

0.18 

0.22 

-0.34 

50811 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50811 

D 

0 

1 

2 

-0.76 

0.00 

0.42 

-0.16 

50812 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50812 

A 

1 

43 

88 

0.42 

0.21 

0.96 

0.37 

50812 

B 

0 

2 

4 

-1.85 

0.46 

0.25 

-0.31 

50812 

C 

0 

2 

4 

-0.77 

0.44 

0.72 

-0.15 

50812 

D 

0 

2 

4 

-0.76 

0.38 

0.71 

-0.15 

50813 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50813 

A 

1 

40 

82 

0.71 

0.20 

0.73 

0.55 

50813 

B 

0 

2 

4 

-1.48 

0.22 

0.27 

-0.27 

50813 

C 

0 

4 

8 

-1.26 

0.29 

0.36 

-0.35 

50813 

D 

0 

3 

6 

-1.11 

0.21 

0.39 

-0.27 

50814 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.00 

50814 

A 

1 

44 

88 

1.08 

0.20 

0.92 

0.41 

50814 

B 

0 

3 

6 

-0.66 

0.52 

0.48 

-0.29 

50814 

C 

0 

1 

2 

0.03 

0.00 

0.78 

-0.09 

50814 

D 

0 

2 

4 

-0.82 

0.37 

0.35 

-0.26 

50815 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50815 

A 

1 

43 

88 

0.71 

0.20 

0.94 

0.40 

50815 

B 

0 

4 

8 

-1.27 

0.21 

0.32 

-0.40 

50815 

C 

0 

1 

2 

-1.02 

0.00 

0.39 

-0.17 

50815 

D 

0 

1 

2 

0.62 

0.00 

2.00 

0.01 

50816 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50816 

A 

1 

30 

63 

0.91 

0.20 

0.90 

0.44 

50816 

B 

0 

1 

2 

-0.43 

0.00 

0.46 

-0.12 

50816 

C 

0 

12 

25 

0.13 

0.29 

1.23 

-0.20 

50816 

D 

0 

5 

10 

-0.70 

0.38 

0.47 

-0.36 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50817 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.02 

50817 

A 

1 

42 

88 

0.83 

0.19 

0.84 

0.46 

50817 

B 

0 

2 

4 

-0.64 

1.05 

0.81 

-0.20 

50817 

C 

0 

3 

6 

-1.18 

0.27 

0.32 

-0.35 

50817 

D 

0 

1 

2 

-1.26 

0.00 

0.27 

-0.20 

50818 

* 

-1 

4715 

99 

0.91 

0.02 

0.00 

0.04 

50818 

A 

1 

41 

89 

0.55 

0.20 

1.01 

0.30 

50818 

B 

0 

1 

2 

-1.00 

0.00 

0.41 

-0.17 

50818 

C 

0 

3 

7 

-0.55 

0.70 

1.08 

-0.20 

50818 

D 

0 

1 

2 

-0.76 

0.00 

0.52 

-0.14 

50819 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50819 

A 

1 

45 

94 

0.69 

0.17 

0.86 

0.42 

50819 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50819 

C 

0 

1 

2 

-2.56 

0.00 

0.08 

-0.38 

50819 

D 

0 

2 

4 

-0.79 

0.04 

0.47 

-0.23 

50820 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50820 

A 

1 

37 

76 

0.97 

0.18 

1.04 

0.31 

50820 

B 

0 

5 

10 

-0.51 

0.56 

0.59 

-0.37 

50820 

C 

0 

6 

12 

0.72 

0.33 

1.67 

-0.02 

50820 

D 

0 

1 

2 

-0.13 

0.00 

0.54 

-0.11 

50821 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.02 

50821 

A 

1 

42 

88 

0.73 

0.18 

1.00 

0.26 

50821 

B 

0 

1 

2 

-1.06 

0.00 

0.30 

-0.20 

50821 

C 

0 

4 

8 

0.35 

0.44 

1.62 

-0.06 

50821 

D 

0 

1 

2 

-1.75 

0.00 

0.15 

-0.28 

50822 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50822 

A 

1 

42 

88 

0.48 

0.20 

1.01 

0.14 

50822 

B 

0 

1 

2 

-0.24 

0.00 

0.78 

-0.08 

50822 

C 

0 

3 

6 

0.56 

0.49 

2.12 

0.03 

50822 

D 

0 

2 

4 

-0.82 

0.14 

0.44 

-0.21 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50823 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.06 

50823 

A 

1 

44 

88 

0.20 

0.16 

0.97 

0.25 

50823 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50823 

C 

0 

1 

2 

-1.30 

0.00 

0.35 

-0.19 

50823 

D 

0 

5 

10 

-0.49 

0.50 

1.23 

-0.18 

50824 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50824 

A 

1 

32 

65 

0.69 

0.14 

0.93 

0.33 

50824 

B 

0 

9 

18 

0.42 

0.35 

1.98 

-0.03 

50824 

C 

0 

3 

6 

-1.15 

0.34 

0.25 

-0.45 

50824 

D 

0 

5 

10 

0.15 

0.31 

0.99 

-0.12 

50825 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50825 

A 

1 

43 

88 

0.93 

0.20 

1.04 

0.33 

50825 

B 

0 

4 

8 

-0.23 

0.52 

1.05 

-0.22 

50825 

C 

0 

2 

4 

-0.77 

0.19 

0.38 

-0.24 

50825 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50826 

* 

-1 

4483 

94 

0.86 

0.02 

0.00 

-0.12 

50826 

A 

1 

96 

35 

2.18 

0.11 

1.21 

0.40 

50826 

B 

0 

42 

15 

0.30 

0.15 

0.37 

-0.46 

50826 

C 

0 

134 

48 

1.57 

0.07 

1.20 

0.02 

50826 

D 

0 

6 

2 

-0.25 

0.37 

0.20 

-0.23 

50827 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

50827 

A 

1 

35 

73 

1.01 

0.25 

1.02 

0.42 

50827 

B 

0 

4 

8 

-0.44 

0.23 

0.58 

-0.23 

50827 

C 

0 

5 

10 

-0.28 

0.51 

1.02 

-0.22 

50827 

D 

0 

4 

8 

-0.34 

0.41 

0.78 

-0.21 

50828 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.04 

50828 

A 

1 

30 

64 

0.96 

0.22 

0.74 

0.51 

50828 

B 

0 

4 

9 

-0.61 

0.56 

0.68 

-0.23 

50828 

C 

0 

7 

15 

0.02 

0.56 

1.92 

-0.12 

50828 

D 

0 

6 

13 

-1.05 

0.28 

0.36 

-0.42 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50829 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.03 

50829 

A 

1 

26 

55 

0.61 

0.22 

1.31 

0.17 

50829 

B 

0 

6 

13 

-0.44 

0.27 

0.55 

-0.30 

50829 

C 

0 

11 

23 

0.76 

0.38 

3.15 

0.16 

50829 

D 

0 

4 

9 

-0.25 

0.34 

0.66 

-0.19 

50830 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50830 

A 

1 

33 

69 

1.04 

0.20 

0.75 

0.61 

50830 

B 

0 

6 

13 

-0.63 

0.27 

0.53 

-0.32 

50830 

C 

0 

2 

4 

-1.17 

0.05 

0.25 

-0.26 

50830 

D 

0 

7 

15 

-0.61 

0.41 

0.70 

-0.35 

50831 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50831 

A 

1 

33 

67 

0.63 

0.16 

0.73 

0.55 

50831 

B 

0 

3 

6 

-1.31 

0.79 

0.43 

-0.32 

50831 

C 

0 

7 

14 

-0.55 

0.43 

0.90 

-0.25 

50831 

D 

0 

6 

12 

-0.78 

0.49 

0.76 

-0.30 

50832 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50832 

A 

1 

41 

84 

1.09 

0.20 

0.86 

0.47 

50832 

B 

0 

1 

2 

-0.21 

0.00 

0.64 

-0.11 

50832 

C 

0 

5 

10 

-0.48 

0.51 

0.79 

-0.31 

50832 

D 

0 

2 

4 

-1.39 

0.66 

0.24 

-0.33 

50833 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50833 

A 

1 

20 

42 

1.47 

0.28 

0.77 

0.59 

50833 

B 

0 

12 

25 

0.23 

0.22 

0.95 

-0.15 

50833 

C 

0 

8 

17 

-0.47 

0.32 

0.49 

-0.35 

50833 

D 

0 

8 

17 

-0.17 

0.40 

0.70 

-0.25 

50834 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50834 

A 

1 

30 

61 

1.13 

0.23 

1.02 

0.50 

50834 

B 

0 

11 

22 

-0.41 

0.25 

0.57 

-0.45 

50834 

C 

0 

5 

10 

0.05 

0.27 

0.80 

-0.16 

50834 

D 

0 

3 

6 

0.42 

0.12 

1.01 

-0.04 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50835 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50835 

A 

1 

35 

71 

0.66 

0.22 

0.87 

0.44 

50835 

B 

0 

4 

8 

-0.39 

0.38 

0.89 

-0.16 

50835 

C 

0 

5 

10 

-0.47 

0.52 

1.09 

-0.20 

50835 

D 

0 

5 

10 

-0.92 

0.38 

0.56 

-0.32 

50836 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50836 

A 

1 

39 

80 

0.93 

0.22 

1.13 

0.39 

50836 

B 

0 

3 

6 

0.53 

0.83 

3.02 

-0.02 

50836 

C 

0 

4 

8 

-0.90 

0.40 

0.43 

-0.32 

50836 

D 

0 

3 

6 

-0.86 

0.75 

0.60 

-0.27 

50837 

* 

-1 

4494 

94 

0.87 

0.02 

0.00 

-0.09 

50837 

A 

1 

200 

75 

1.62 

0.08 

1.04 

0.34 

50837 

B 

0 

11 

4 

0.24 

0.37 

1.10 

-0.20 

50837 

C 

0 

53 

20 

0.81 

0.12 

1.19 

-0.23 

50837 

D 

0 

3 

1 

-0.07 

0.61 

0.43 

-0.13 

50838 

* 

-1 

4486 

94 

0.86 

0.02 

0.00 

-0.14 

50838 

A 

1 

259 

94 

1.73 

0.06 

0.97 

0.34 

50838 

B 

0 

7 

3 

0.34 

0.36 

0.74 

-0.20 

50838 

C 

0 

9 

3 

0.12 

0.28 

0.47 

-0.27 

50838 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50839 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50839 

A 

1 

42 

86 

0.34 

0.18 

0.96 

0.37 

50839 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50839 

C 

0 

3 

6 

-0.12 

0.31 

1.31 

-0.05 

50839 

D 

0 

4 

8 

-1.77 

0.98 

0.51 

-0.43 

50840 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50840 

A 

1 

41 

85 

0.60 

0.22 

0.99 

0.33 

50840 

B 

0 

1 

2 

-0.04 

0.00 

1.18 

-0.04 

50840 

C 

0 

1 

2 

1.13 

0.00 

3.83 

0.07 

50840 

D 

0 

5 

10 

-1.29 

0.54 

0.52 

-0.39 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50841 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.06 

50841 

A 

1 

38 

79 

0.54 

0.20 

0.79 

0.57 

50841 

B 

0 

2 

4 

-0.40 

0.76 

1.22 

-0.08 

50841 

C 

0 

2 

4 

-0.86 

0.25 

0.61 

-0.15 

50841 

D 

0 

6 

13 

-1.96 

0.32 

0.25 

-0.56 

50842 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50842 

A 

1 

8 

16 

1.33 

0.55 

1.95 

0.22 

50842 

B 

0 

4 

8 

-1.42 

0.41 

0.09 

-0.38 

50842 

C 

0 

30 

61 

0.79 

0.22 

1.40 

0.18 

50842 

D 

0 

7 

14 

-0.12 

0.86 

0.88 

-0.18 

50843 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50843 

A 

1 

10 

20 

0.73 

0.53 

3.35 

0.11 

50843 

B 

0 

2 

4 

-0.23 

0.53 

0.39 

-0.12 

50843 

C 

0 

31 

63 

0.45 

0.18 

1.08 

-0.02 

50843 

D 

0 

6 

12 

0.36 

0.63 

1.75 

-0.03 

50844 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50844 

A 

1 

45 

92 

0.38 

0.14 

0.88 

0.31 

50844 

B 

0 

1 

2 

-1.20 

0.00 

0.35 

-0.21 

50844 

C 

0 

2 

4 

0.39 

1.14 

2.90 

0.02 

50844 

D 

0 

1 

2 

-2.70 

0.00 

0.08 

-0.42 

50845 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

50845 

A 

1 

44 

88 

0.65 

0.17 

1.03 

0.24 

50845 

B 

0 

4 

8 

0.24 

0.94 

3.24 

-0.08 

50845 

C 

0 

2 

4 

-1.13 

0.72 

0.38 

-0.29 

50845 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50846 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50846 

A 

1 

45 

92 

0.63 

0.16 

0.96 

0.50 

50846 

B 

0 

1 

2 

-1.02 

0.00 

0.31 

-0.14 

50846 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50846 

D 

0 

3 

6 

-2.35 

2.02 

0.62 

-0.48 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50847 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50847 

A 

1 

42 

88 

0.51 

0.19 

0.95 

0.31 

50847 

B 

0 

2 

4 

-0.99 

0.86 

0.62 

-0.22 

50847 

C 

0 

2 

4 

0.71 

0.31 

2.56 

0.06 

50847 

D 

0 

2 

4 

-1.87 

0.74 

0.24 

-0.36 

50848 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50848 

A 

1 

34 

67 

0.76 

0.20 

1.01 

0.32 

50848 

B 

0 

5 

10 

-0.22 

0.30 

0.73 

-0.21 

50848 

C 

0 

6 

12 

0.43 

0.40 

1.64 

-0.02 

50848 

D 

0 

6 

12 

-0.25 

0.48 

1.05 

-0.24 

50849 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50849 

A 

1 

34 

71 

0.73 

0.21 

1.15 

0.27 

50849 

B 

0 

1 

2 

1.72 

0.00 

4.27 

0.15 

50849 

C 

0 

4 

8 

0.55 

0.27 

1.47 

0.01 

50849 

D 

0 

9 

19 

-0.39 

0.34 

0.76 

-0.37 

50850 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50850 

A 

1 

13 

27 

1.09 

0.41 

1.25 

0.34 

50850 

B 

0 

11 

22 

0.11 

0.26 

0.84 

-0.14 

50850 

C 

0 

9 

18 

0.58 

0.46 

2.42 

0.07 

50850 

D 

0 

16 

33 

-0.01 

0.20 

0.68 

-0.25 

50851 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.02 

50851 

A 

1 

41 

87 

0.72 

0.17 

0.96 

0.31 

50851 

B 

0 

1 

2 

0.76 

0.00 

1.75 

0.02 

50851 

C 

0 

4 

9 

-0.61 

0.40 

0.58 

-0.33 

50851 

D 

0 

1 

2 

-0.14 

0.00 

0.72 

-0.10 

50852 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.06 

50852 

A 

1 

39 

81 

0.29 

0.18 

1.10 

0.28 

50852 

B 

0 

7 

15 

-0.64 

0.24 

0.74 

-0.30 

50852 

C 

0 

2 

4 

0.10 

0.33 

1.39 

-0.01 

50852 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Fifth Grade Math Measure Development 


364 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50853 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50853 

A 

1 

43 

90 

0.62 

0.22 

0.79 

0.51 

50853 

B 

0 

1 

2 

-0.48 

0.00 

1.05 

-0.07 

50853 

C 

0 

1 

2 

-0.98 

0.00 

0.63 

-0.12 

50853 

D 

0 

3 

6 

-2.96 

0.74 

0.13 

-0.52 

50854 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.06 

50854 

A 

1 

44 

92 

0.10 

0.16 

1.05 

0.16 

50854 

B 

0 

1 

2 

0.38 

0.00 

2.10 

0.05 

50854 

C 

0 

2 

4 

-0.49 

0.73 

1.13 

-0.11 

50854 

D 

0 

1 

2 

-1.40 

0.00 

0.35 

-0.20 

50855 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50855 

A 

1 

42 

86 

0.64 

0.17 

0.84 

0.42 

50855 

B 

0 

1 

2 

-1.22 

0.00 

0.29 

-0.20 

50855 

C 

0 

2 

4 

-1.35 

1.21 

0.47 

-0.31 

50855 

D 

0 

4 

8 

-0.38 

0.55 

1.01 

-0.21 

50856 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50856 

A 

-1 

49 

100 

0.52 

0.17 

0.00 

0.00 

50856 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50856 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50856 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

50857 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50857 

A 

1 

46 

94 

0.42 

0.18 

0.80 

0.32 

50857 

B 

0 

1 

2 

0.54 

0.00 

2.65 

0.03 

50857 

C 

0 

1 

2 

-0.14 

0.00 

1.34 

-0.05 

50857 

D 

0 

1 

2 

-4.43 

0.00 

0.02 

-0.51 

50858 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50858 

A 

1 

36 

73 

0.80 

0.21 

1.04 

0.31 

50858 

B 

0 

8 

16 

-0.03 

0.40 

1.50 

-0.21 

50858 

C 

0 

1 

2 

0.03 

0.00 

0.83 

-0.06 

50858 

D 

0 

4 

8 

-0.20 

0.11 

0.67 

-0.19 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50859 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50859 

A 

1 

26 

53 

0.83 

0.23 

0.99 

0.46 

50859 

B 

0 

3 

6 

-1.23 

0.35 

0.27 

-0.27 

50859 

C 

0 

8 

16 

-0.04 

0.34 

1.12 

-0.09 

50859 

D 

0 

12 

24 

-0.48 

0.45 

0.94 

-0.30 

50860 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50860 

A 

1 

34 

69 

0.76 

0.19 

0.78 

0.52 

50860 

B 

0 

10 

20 

-0.82 

0.33 

0.75 

-0.47 

50860 

C 

0 

2 

4 

-0.18 

0.42 

0.87 

-0.09 

50860 

D 

0 

3 

6 

-0.31 

0.61 

1.04 

-0.13 

50861 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50861 

A 

1 

23 

47 

0.80 

0.30 

1.15 

0.38 

50861 

B 

0 

9 

18 

-0.49 

0.32 

0.70 

-0.25 

50861 

C 

0 

13 

27 

0.14 

0.23 

1.29 

-0.04 

50861 

D 

0 

4 

8 

-1.03 

1.23 

0.85 

-0.27 

50862 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50862 

A 

1 

33 

67 

1.14 

0.20 

0.79 

0.46 

50862 

B 

0 

10 

20 

0.11 

0.53 

2.61 

-0.21 

50862 

C 

0 

3 

6 

-0.64 

0.43 

0.43 

-0.25 

50862 

D 

0 

3 

6 

-0.92 

0.66 

0.40 

-0.30 

50863 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.02 

50863 

A 

1 

35 

69 

0.84 

0.22 

1.11 

0.25 

50863 

B 

0 

14 

27 

0.26 

0.17 

1.08 

-0.21 

50863 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50863 

D 

0 

2 

4 

0.01 

0.15 

0.71 

-0.11 

50864 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50864 

A 

1 

36 

73 

0.66 

0.23 

1.22 

0.28 

50864 

B 

0 

10 

20 

-0.21 

0.26 

0.97 

-0.26 

50864 

C 

0 

2 

4 

0.36 

0.05 

1.29 

-0.01 

50864 

D 

0 

1 

2 

-0.62 

0.00 

0.48 

-0.12 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50865 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50865 

A 

1 

39 

80 

0.63 

0.21 

1.00 

0.37 

50865 

B 

0 

4 

8 

-0.48 

0.30 

0.70 

-0.20 

50865 

C 

0 

1 

2 

-0.71 

0.00 

0.50 

-0.13 

50865 

D 

0 

5 

10 

-0.56 

0.39 

0.79 

-0.25 

50866 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50866 

A 

1 

31 

63 

0.55 

0.18 

0.85 

0.43 

50866 

B 

0 

3 

6 

-0.46 

0.34 

0.70 

-0.13 

50866 

C 

0 

8 

16 

-0.41 

0.29 

0.84 

-0.21 

50866 

D 

0 

7 

14 

-0.70 

0.72 

1.14 

-0.29 

50867 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.02 

50867 

A 

1 

45 

94 

0.63 

0.20 

1.05 

0.11 

50867 

B 

0 

1 

2 

0.68 

0.00 

1.97 

0.01 

50867 

C 

0 

2 

4 

-0.29 

0.76 

0.97 

-0.14 

50867 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50868 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50868 

A 

1 

41 

84 

0.55 

0.17 

0.71 

0.57 

50868 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50868 

C 

0 

5 

10 

-0.80 

0.42 

1.01 

-0.22 

50868 

D 

0 

3 

6 

-3.42 

1.10 

0.15 

-0.61 

50869 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50869 

A 

1 

39 

80 

0.84 

0.18 

0.98 

0.39 

50869 

B 

0 

1 

2 

0.47 

0.00 

1.22 

-0.02 

50869 

C 

0 

8 

16 

-0.40 

0.28 

0.63 

-0.39 

50869 

D 

0 

1 

2 

0.03 

0.00 

0.79 

-0.07 

50870 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.02 

50870 

A 

1 

47 

98 

0.65 

0.15 

0.98 

0.26 

50870 

B 

0 

1 

2 

-1.33 

0.00 

0.25 

-0.26 

50870 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50870 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50871 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.06 

50871 

A 

1 

28 

58 

0.54 

0.18 

1.03 

0.42 

50871 

B 

0 

4 

8 

-0.05 

0.24 

0.94 

-0.05 

50871 

C 

0 

13 

27 

-0.21 

0.23 

1.09 

-0.18 

50871 

D 

0 

3 

6 

-1.92 

1.34 

0.34 

-0.46 

50872 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50872 

A 

1 

34 

71 

0.79 

0.18 

0.87 

0.50 

50872 

B 

0 

1 

2 

-0.26 

0.00 

0.63 

-0.09 

50872 

C 

0 

9 

19 

-0.56 

0.38 

0.84 

-0.41 

50872 

D 

0 

4 

8 

-0.30 

0.26 

0.67 

-0.19 

50873 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50873 

A 

1 

6 

13 

0.78 

0.43 

1.53 

0.12 

50873 

B 

0 

24 

50 

0.66 

0.19 

1.22 

0.24 

50873 

C 

0 

5 

10 

0.26 

0.77 

1.48 

-0.01 

50873 

D 

0 

13 

27 

-0.58 

0.59 

0.67 

-0.36 

50874 

* 

-1 

4495 

94 

0.88 

0.02 

0.00 

-0.08 

50874 

A 

1 

246 

92 

1.46 

0.07 

1.01 

0.34 

50874 

B 

0 

12 

5 

-0.29 

0.24 

0.48 

-0.29 

50874 

C 

0 

7 

3 

0.27 

0.29 

0.72 

-0.14 

50874 

D 

0 

1 

0 

-0.98 

0.00 

0.17 

-0.12 

50875 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50875 

A 

1 

38 

78 

0.89 

0.22 

0.91 

0.55 

50875 

B 

0 

4 

8 

-0.98 

0.22 

0.40 

-0.23 

50875 

C 

0 

2 

4 

-1.08 

0.43 

0.37 

-0.17 

50875 

D 

0 

5 

10 

-1.89 

1.32 

1.15 

-0.43 

50876 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.07 

50876 

A 

1 

26 

53 

0.42 

0.22 

1.25 

0.31 

50876 

B 

0 

11 

22 

0.14 

0.27 

1.75 

0.05 

50876 

C 

0 

4 

8 

0.14 

0.26 

1.13 

0.03 

50876 

D 

0 

8 

16 

-1.57 

0.79 

0.63 

-0.49 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50877 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50877 

A 

1 

15 

31 

0.64 

0.27 

1.49 

0.13 

50877 

B 

0 

24 

49 

0.42 

0.23 

1.44 

-0.01 

50877 

C 

0 

5 

10 

-0.16 

0.36 

0.59 

-0.19 

50877 

D 

0 

5 

10 

0.43 

0.61 

1.68 

0.00 

50878 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50878 

A 

1 

43 

88 

0.65 

0.18 

0.91 

0.45 

50878 

B 

0 

2 

4 

-0.92 

0.93 

0.61 

-0.23 

50878 

C 

0 

2 

4 

-1.00 

0.40 

0.42 

-0.24 

50878 

D 

0 

2 

4 

-1.13 

0.47 

0.38 

-0.27 

50879 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50879 

A 

1 

39 

80 

1.03 

0.19 

0.81 

0.51 

50879 

B 

0 

4 

8 

-0.96 

0.27 

0.33 

-0.38 

50879 

C 

0 

3 

6 

-0.15 

0.50 

0.86 

-0.17 

50879 

D 

0 

3 

6 

-0.62 

0.25 

0.44 

-0.26 

50880 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50880 

A 

1 

43 

88 

0.94 

0.18 

0.89 

0.38 

50880 

B 

0 

3 

6 

-0.03 

0.72 

1.09 

-0.17 

50880 

C 

0 

2 

4 

-0.57 

0.25 

0.42 

-0.23 

50880 

D 

0 

1 

2 

-1.29 

0.00 

0.20 

-0.25 

50881 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50881 

A 

1 

32 

65 

1.01 

0.23 

0.83 

0.62 

50881 

B 

0 

3 

6 

-1.04 

0.71 

0.54 

-0.24 

50881 

C 

0 

9 

18 

-0.76 

0.37 

0.74 

-0.36 

50881 

D 

0 

5 

10 

-1.05 

0.17 

0.35 

-0.32 

50882 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50882 

A 

1 

32 

65 

1.05 

0.19 

0.76 

0.57 

50882 

B 

0 

3 

6 

-0.32 

0.19 

0.54 

-0.20 

50882 

C 

0 

10 

20 

-0.41 

0.27 

0.73 

-0.43 

50882 

D 

0 

4 

8 

-0.15 

0.25 

0.68 

-0.19 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50883 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

50883 

A 

1 

26 

48 

0.93 

0.21 

1.20 

0.29 

50883 

B 

0 

19 

35 

0.58 

0.24 

1.55 

0.01 

50883 

C 

0 

4 

7 

-0.15 

0.22 

0.51 

-0.16 

50883 

D 

0 

5 

9 

-0.93 

0.91 

0.78 

-0.38 

50884 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50884 

A 

1 

42 

86 

0.75 

0.17 

1.08 

0.22 

50884 

B 

0 

3 

6 

-0.36 

0.65 

0.78 

-0.23 

50884 

C 

0 

4 

8 

0.37 

0.60 

1.81 

-0.07 

50884 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50885 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50885 

A 

1 

38 

78 

0.72 

0.20 

1.04 

0.38 

50885 

B 

0 

3 

6 

-0.44 

0.49 

0.73 

-0.19 

50885 

C 

0 

1 

2 

0.29 

0.00 

1.18 

-0.02 

50885 

D 

0 

7 

14 

-0.48 

0.41 

0.91 

-0.31 

50886 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50886 

A 

1 

12 

25 

1.71 

0.32 

0.54 

0.67 

50886 

B 

0 

1 

2 

-1.58 

0.00 

0.11 

-0.26 

50886 

C 

0 

32 

67 

0.12 

0.12 

0.72 

-0.38 

50886 

D 

0 

3 

6 

-0.86 

0.41 

0.26 

-0.29 

50887 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50887 

A 

1 

47 

96 

0.65 

0.20 

0.86 

0.35 

50887 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50887 

C 

0 

2 

4 

-1.82 

0.31 

0.19 

-0.35 

50887 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50888 

* 

-1 

1970 

41 

1.45 

0.03 

0.00 

0.34 

50888 

A 

1 

1406 

50 

1.16 

0.03 

1.02 

0.50 

50888 

B 

0 

551 

20 

-0.03 

0.04 

0.93 

-0.21 

50888 

C 

0 

300 

11 

-0.18 

0.06 

0.87 

-0.19 

50888 

D 

0 

534 

19 

-0.22 

0.05 

0.79 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50889 

* 

-1 

4487 

94 

0.85 

0.02 

0.00 

-0.15 

50889 

A 

1 

207 

76 

2.08 

0.08 

0.82 

0.52 

50889 

B 

0 

35 

13 

0.51 

0.18 

0.70 

-0.35 

50889 

C 

0 

24 

9 

0.59 

0.17 

0.67 

-0.26 

50889 

D 

0 

8 

3 

0.08 

0.28 

0.37 

-0.21 

50890 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50890 

A 

1 

28 

57 

1.65 

0.29 

0.73 

0.62 

50890 

B 

0 

8 

16 

-0.17 

0.39 

0.87 

-0.25 

50890 

C 

0 

7 

14 

-1.10 

0.21 

0.25 

-0.46 

50890 

D 

0 

6 

12 

0.09 

0.36 

0.90 

-0.15 

50891 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50891 

A 

1 

34 

69 

0.95 

0.20 

0.71 

0.63 

50891 

B 

0 

2 

4 

-1.40 

0.65 

0.29 

-0.20 

50891 

C 

0 

2 

4 

-0.78 

0.00 

0.45 

-0.13 

50891 

D 

0 

11 

22 

-1.43 

0.58 

0.61 

-0.54 

50892 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50892 

A 

1 

25 

51 

1.01 

0.27 

1.08 

0.47 

50892 

B 

0 

6 

12 

0.68 

0.17 

1.52 

0.07 

50892 

C 

0 

4 

8 

-0.53 

0.11 

0.43 

-0.24 

50892 

D 

0 

14 

29 

-0.36 

0.19 

0.62 

-0.42 

50893 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50893 

A 

1 

27 

55 

0.85 

0.25 

0.83 

0.50 

50893 

B 

0 

10 

20 

-0.67 

0.38 

0.99 

-0.37 

50893 

C 

0 

3 

6 

-0.39 

0.14 

0.62 

-0.13 

50893 

D 

0 

9 

18 

-0.18 

0.21 

0.89 

-0.17 

50894 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50894 

A 

1 

21 

43 

1.78 

0.30 

0.96 

0.56 

50894 

B 

0 

10 

20 

0.35 

0.29 

0.97 

-0.08 

50894 

C 

0 

8 

16 

0.26 

0.28 

0.79 

-0.09 

50894 

D 

0 

10 

20 

-1.17 

0.68 

0.42 

-0.52 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50895 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50895 

A 

1 

32 

63 

0.96 

0.27 

1.05 

0.36 

50895 

B 

0 

5 

10 

0.31 

0.43 

1.48 

-0.06 

50895 

C 

0 

4 

8 

-0.30 

0.55 

0.94 

-0.17 

50895 

D 

0 

10 

20 

-0.24 

0.41 

1.33 

-0.27 

50896 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50896 

A 

1 

30 

61 

1.15 

0.25 

0.91 

0.53 

50896 

B 

0 

4 

8 

-0.39 

0.17 

0.53 

-0.18 

50896 

C 

0 

7 

14 

-0.49 

0.36 

0.65 

-0.27 

50896 

D 

0 

8 

16 

-0.54 

0.59 

0.72 

-0.31 

50897 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.01 

50897 

A 

1 

40 

74 

1.09 

0.21 

1.13 

0.36 

50897 

B 

0 

4 

7 

-0.26 

0.62 

0.84 

-0.22 

50897 

C 

0 

5 

9 

0.40 

0.48 

1.43 

-0.10 

50897 

D 

0 

5 

9 

-0.22 

0.65 

1.16 

-0.24 

50898 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50898 

A 

1 

36 

75 

0.79 

0.19 

0.88 

0.41 

50898 

B 

0 

5 

10 

0.03 

0.41 

1.21 

-0.13 

50898 

C 

0 

3 

6 

-0.19 

0.82 

1.38 

-0.15 

50898 

D 

0 

4 

8 

-1.00 

0.47 

0.42 

-0.37 

50899 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50899 

A 

1 

30 

61 

0.84 

0.24 

0.97 

0.38 

50899 

B 

0 

4 

8 

0.36 

0.32 

1.40 

-0.01 

50899 

C 

0 

9 

18 

-0.68 

0.42 

0.91 

-0.37 

50899 

D 

0 

6 

12 

-0.07 

0.68 

2.00 

-0.13 

50900 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50900 

A 

1 

33 

67 

0.97 

0.20 

0.97 

0.40 

50900 

B 

0 

13 

27 

-0.07 

0.25 

0.85 

-0.37 

50900 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50900 

D 

0 

3 

6 

0.19 

0.80 

1.37 

-0.10 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50901 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

50901 

A 

1 

24 

50 

1.15 

0.30 

1.05 

0.40 

50901 

B 

0 

4 

8 

-0.26 

0.41 

0.62 

-0.20 

50901 

C 

0 

11 

23 

0.26 

0.30 

1.34 

-0.15 

50901 

D 

0 

9 

19 

0.04 

0.30 

0.96 

-0.21 

50902 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50902 

A 

1 

29 

59 

0.82 

0.24 

1.15 

0.33 

50902 

B 

0 

8 

16 

0.39 

0.33 

1.42 

-0.05 

50902 

C 

0 

6 

12 

0.13 

0.28 

0.98 

-0.12 

50902 

D 

0 

6 

12 

-0.48 

0.26 

0.54 

-0.32 

50903 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50903 

A 

1 

32 

67 

0.67 

0.17 

1.05 

0.38 

50903 

B 

0 

5 

10 

-0.58 

0.17 

0.46 

-0.33 

50903 

C 

0 

6 

13 

0.80 

0.22 

1.89 

0.15 

50903 

D 

0 

5 

10 

-0.81 

0.37 

0.43 

-0.41 

50904 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

50904 

A 

1 

42 

88 

0.71 

0.20 

1.07 

0.13 

50904 

B 

0 

2 

4 

0.47 

0.64 

1.68 

-0.03 

50904 

C 

0 

3 

6 

0.67 

0.29 

1.85 

0.00 

50904 

D 

0 

1 

2 

-1.60 

0.00 

0.17 

-0.26 

50905 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50905 

A 

1 

38 

78 

1.00 

0.23 

1.42 

0.35 

50905 

B 

0 

7 

14 

0.11 

0.51 

2.08 

-0.17 

50905 

C 

0 

2 

4 

-0.35 

0.04 

0.57 

-0.15 

50905 

D 

0 

2 

4 

-1.29 

0.32 

0.24 

-0.29 

50906 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

50906 

A 

1 

37 

71 

0.93 

0.19 

0.91 

0.39 

50906 

B 

0 

5 

10 

-0.41 

0.37 

0.60 

-0.28 

50906 

C 

0 

3 

6 

0.81 

0.16 

1.63 

0.04 

50906 

D 

0 

7 

13 

-0.28 

0.56 

1.24 

-0.30 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50907 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50907 

A 

1 

31 

65 

0.96 

0.27 

0.97 

0.52 

50907 

B 

0 

2 

4 

-0.59 

0.95 

0.82 

-0.09 

50907 

C 

0 

9 

19 

-0.05 

0.17 

1.06 

-0.07 

50907 

D 

0 

6 

13 

-2.98 

0.95 

0.46 

-0.63 

50908 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50908 

A 

1 

35 

71 

0.67 

0.22 

1.10 

0.30 

50908 

B 

0 

7 

14 

-0.45 

0.36 

0.90 

-0.29 

50908 

C 

0 

1 

2 

-1.19 

0.00 

0.28 

-0.19 

50908 

D 

0 

6 

12 

0.35 

0.40 

1.75 

-0.02 

50909 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50909 

A 

1 

43 

88 

0.58 

0.11 

0.87 

0.45 

50909 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50909 

C 

0 

3 

6 

-0.79 

0.24 

0.39 

-0.38 

50909 

D 

0 

3 

6 

-0.32 

0.68 

0.97 

-0.23 

50910 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50910 

A 

1 

41 

84 

0.58 

0.17 

0.86 

0.48 

50910 

B 

0 

2 

4 

-0.63 

0.32 

0.62 

-0.16 

50910 

C 

0 

1 

2 

0.79 

0.00 

2.44 

0.06 

50910 

D 

0 

5 

10 

-1.50 

0.39 

0.32 

-0.51 

50911 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50911 

A 

1 

27 

56 

1.20 

0.22 

0.67 

0.67 

50911 

B 

0 

6 

13 

-0.68 

0.34 

0.55 

-0.30 

50911 

C 

0 

6 

13 

-0.64 

0.27 

0.49 

-0.29 

50911 

D 

0 

9 

19 

-0.59 

0.33 

0.65 

-0.35 

50912 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.02 

50912 

A 

1 

36 

75 

0.92 

0.19 

0.88 

0.48 

50912 

B 

0 

5 

10 

-0.16 

0.25 

0.72 

-0.23 

50912 

C 

0 

6 

13 

-0.54 

0.26 

0.51 

-0.37 

50912 

D 

0 

1 

2 

-0.22 

0.00 

0.60 

-0.10 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50913 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50913 

A 

1 

33 

67 

1.22 

0.24 

0.90 

0.46 

50913 

B 

0 

3 

6 

-0.97 

0.59 

0.33 

-0.29 

50913 

C 

0 

5 

10 

0.18 

0.31 

0.98 

-0.12 

50913 

D 

0 

8 

16 

-0.28 

0.59 

1.17 

-0.30 

50914 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.00 

50914 

A 

1 

33 

69 

1.39 

0.30 

3.17 

0.46 

50914 

B 

0 

8 

17 

-0.13 

0.19 

0.63 

-0.28 

50914 

C 

0 

3 

6 

-0.57 

0.68 

0.58 

-0.23 

50914 

D 

0 

4 

8 

-0.19 

0.21 

0.57 

-0.20 

50915 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.00 

50915 

A 

1 

34 

71 

1.35 

0.22 

0.83 

0.57 

50915 

B 

0 

7 

15 

-0.58 

0.23 

0.43 

-0.44 

50915 

C 

0 

6 

13 

0.03 

0.20 

0.71 

-0.23 

50915 

D 

0 

1 

2 

-0.98 

0.00 

0.23 

-0.20 

50916 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.06 

50916 

A 

1 

28 

60 

0.63 

0.20 

0.92 

0.53 

50916 

B 

0 

7 

15 

-0.80 

0.31 

0.58 

-0.37 

50916 

C 

0 

4 

9 

-0.33 

0.24 

0.75 

-0.14 

50916 

D 

0 

8 

17 

-0.43 

0.31 

0.82 

-0.24 

50917 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50917 

A 

1 

25 

52 

1.48 

0.29 

0.87 

0.64 

50917 

B 

0 

5 

10 

-0.85 

0.52 

0.50 

-0.32 

50917 

C 

0 

4 

8 

-0.09 

0.28 

0.72 

-0.13 

50917 

D 

0 

14 

29 

-0.37 

0.20 

0.58 

-0.40 

50918 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50918 

A 

1 

18 

37 

1.46 

0.27 

0.73 

0.59 

50918 

B 

0 

3 

6 

-0.19 

0.59 

0.62 

-0.15 

50918 

C 

0 

12 

24 

-0.16 

0.27 

0.66 

-0.31 

50918 

D 

0 

16 

33 

0.08 

0.22 

0.83 

-0.25 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50919 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50919 

A 

1 

17 

35 

1.04 

0.34 

1.28 

0.39 

50919 

B 

0 

2 

4 

0.79 

0.15 

1.29 

0.07 

50919 

C 

0 

9 

18 

0.16 

0.34 

1.12 

-0.09 

50919 

D 

0 

21 

43 

-0.07 

0.23 

0.85 

-0.33 

50920 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.06 

50920 

A 

1 

23 

49 

0.86 

0.26 

0.89 

0.50 

50920 

B 

0 

12 

26 

-0.17 

0.24 

1.01 

-0.14 

50920 

C 

0 

1 

2 

-1.09 

0.00 

0.30 

-0.13 

50920 

D 

0 

11 

23 

-0.84 

0.43 

0.84 

-0.40 

50921 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50921 

A 

1 

24 

49 

0.61 

0.19 

1.28 

0.24 

50921 

B 

0 

12 

24 

0.12 

0.20 

0.90 

-0.20 

50921 

C 

0 

13 

27 

0.29 

0.20 

1.13 

-0.09 

50921 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50922 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50922 

A 

1 

31 

63 

0.56 

0.22 

1.06 

0.40 

50922 

B 

0 

4 

8 

-0.30 

0.38 

0.92 

-0.13 

50922 

C 

0 

12 

24 

-0.31 

0.24 

0.98 

-0.25 

50922 

D 

0 

2 

4 

-1.24 

0.54 

0.34 

-0.25 

50923 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50923 

A 

1 

30 

61 

1.28 

0.19 

0.71 

0.63 

50923 

B 

0 

16 

33 

-0.41 

0.27 

0.69 

-0.55 

50923 

C 

0 

2 

4 

-0.68 

0.83 

0.43 

-0.20 

50923 

D 

0 

1 

2 

0.14 

0.00 

0.72 

-0.05 

50924 

* 

-1 

4495 

94 

0.90 

0.02 

0.00 

0.00 

50924 

A 

1 

191 

72 

1.16 

0.07 

0.99 

0.40 

50924 

B 

0 

22 

8 

0.19 

0.20 

0.87 

-0.21 

50924 

C 

0 

49 

18 

0.35 

0.09 

0.85 

-0.26 

50924 

D 

0 

4 

2 

-0.48 

0.52 

0.45 

-0.17 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50925 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50925 

A 

1 

27 

55 

0.96 

0.24 

1.14 

0.45 

50925 

B 

0 

10 

20 

0.14 

0.23 

1.01 

-0.14 

50925 

C 

0 

4 

8 

-0.26 

0.27 

0.58 

-0.19 

50925 

D 

0 

8 

16 

-0.37 

0.36 

0.72 

-0.32 

50926 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50926 

A 

1 

28 

57 

0.58 

0.26 

1.34 

0.28 

50926 

B 

0 

7 

14 

0.00 

0.52 

2.45 

-0.09 

50926 

C 

0 

9 

18 

-0.40 

0.23 

0.76 

-0.26 

50926 

D 

0 

5 

10 

0.17 

0.22 

1.22 

-0.03 

50927 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50927 

A 

1 

27 

53 

1.24 

0.21 

0.77 

0.58 

50927 

B 

0 

5 

10 

0.04 

0.30 

0.74 

-0.14 

50927 

C 

0 

12 

24 

-0.01 

0.21 

0.73 

-0.27 

50927 

D 

0 

7 

14 

-0.60 

0.50 

0.61 

-0.38 

50928 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50928 

A 

1 

31 

63 

1.26 

0.19 

0.77 

0.58 

50928 

B 

0 

6 

12 

0.41 

0.52 

2.00 

-0.09 

50928 

C 

0 

6 

12 

-0.77 

0.37 

0.41 

-0.44 

50928 

D 

0 

6 

12 

-0.38 

0.19 

0.46 

-0.33 

50929 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50929 

A 

1 

16 

33 

1.82 

0.32 

0.73 

0.65 

50929 

B 

0 

5 

10 

-0.27 

0.60 

0.63 

-0.19 

50929 

C 

0 

18 

38 

-0.06 

0.23 

0.75 

-0.31 

50929 

D 

0 

9 

19 

-0.22 

0.35 

0.67 

-0.25 

50930 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50930 

A 

1 

36 

73 

1.18 

0.18 

0.69 

0.62 

50930 

B 

0 

6 

12 

-0.40 

0.43 

0.71 

-0.29 

50930 

C 

0 

3 

6 

-0.27 

0.49 

0.67 

-0.18 

50930 

D 

0 

4 

8 

-1.57 

0.54 

0.24 

-0.49 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50931 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50931 

A 

1 

33 

67 

0.65 

0.21 

1.01 

0.46 

50931 

B 

0 

8 

16 

0.02 

0.23 

1.14 

-0.04 

50931 

C 

0 

1 

2 

-0.95 

0.00 

0.37 

-0.10 

50931 

D 

0 

7 

14 

-1.87 

0.85 

0.54 

-0.53 

50932 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50932 

A 

1 

22 

46 

1.12 

0.17 

0.71 

0.51 

50932 

B 

0 

5 

10 

0.29 

0.77 

2.05 

0.01 

50932 

C 

0 

11 

23 

-0.22 

0.28 

0.67 

-0.17 

50932 

D 

0 

10 

21 

-1.09 

0.68 

0.57 

-0.46 

50933 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50933 

A 

1 

27 

56 

0.85 

0.25 

1.01 

0.47 

50933 

B 

0 

6 

13 

-0.41 

0.26 

0.64 

-0.16 

50933 

C 

0 

6 

13 

-0.15 

0.40 

1.02 

-0.09 

50933 

D 

0 

9 

19 

-0.97 

0.64 

0.77 

-0.39 

50934 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50934 

A 

1 

27 

53 

0.97 

0.21 

1.13 

0.44 

50934 

B 

0 

9 

18 

0.60 

0.27 

1.65 

0.03 

50934 

C 

0 

6 

12 

-0.22 

0.30 

0.65 

-0.25 

50934 

D 

0 

9 

18 

-0.40 

0.23 

0.55 

-0.40 

50935 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50935 

A 

1 

29 

59 

0.67 

0.20 

1.17 

0.24 

50935 

B 

0 

8 

16 

0.04 

0.32 

1.16 

-0.18 

50935 

C 

0 

8 

16 

0.13 

0.35 

1.30 

-0.14 

50935 

D 

0 

4 

8 

0.49 

0.40 

1.57 

0.01 

50936 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50936 

A 

1 

22 

45 

1.09 

0.26 

0.85 

0.49 

50936 

B 

0 

8 

16 

-0.73 

0.22 

0.39 

-0.44 

50936 

C 

0 

10 

20 

0.33 

0.33 

1.58 

-0.05 

50936 

D 

0 

9 

18 

0.07 

0.21 

0.85 

-0.15 



easyCBM CCSS Fifth Grade Math Measure Development 


378 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50937 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.06 

50937 

A 

1 

29 

60 

0.65 

0.25 

1.01 

0.46 

50937 

B 

0 

1 

2 

-0.71 

0.00 

0.50 

-0.08 

50937 

C 

0 

7 

15 

-0.46 

0.36 

0.94 

-0.15 

50937 

D 

0 

11 

23 

-0.96 

0.51 

0.80 

-0.38 

50938 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50938 

A 

1 

29 

60 

1.02 

0.21 

0.78 

0.60 

50938 

B 

0 

3 

6 

-0.25 

0.57 

0.88 

-0.13 

50938 

C 

0 

5 

10 

-0.79 

0.46 

0.50 

-0.33 

50938 

D 

0 

11 

23 

-0.48 

0.19 

0.62 

-0.39 

50939 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.04 

50939 

A 

1 

30 

64 

0.61 

0.17 

1.11 

0.38 

50939 

B 

0 

8 

17 

-0.13 

0.29 

0.92 

-0.22 

50939 

C 

0 

4 

9 

0.19 

0.58 

1.56 

-0.05 

50939 

D 

0 

5 

11 

-0.45 

0.29 

0.60 

-0.28 

50940 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50940 

A 

1 

21 

43 

1.14 

0.26 

0.74 

0.54 

50940 

B 

0 

11 

22 

0.04 

0.15 

0.82 

-0.04 

50940 

C 

0 

3 

6 

-0.67 

0.58 

0.52 

-0.14 

50940 

D 

0 

14 

29 

-1.01 

0.49 

0.58 

-0.48 

50941 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50941 

A 

1 

41 

84 

0.57 

0.22 

0.99 

0.45 

50941 

B 

0 

2 

4 

0.40 

0.12 

1.94 

0.02 

50941 

C 

0 

2 

4 

-0.72 

0.60 

0.75 

-0.11 

50941 

D 

0 

4 

8 

-2.93 

1.23 

0.41 

-0.54 

50942 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50942 

A 

1 

40 

82 

0.47 

0.18 

0.88 

0.45 

50942 

B 

0 

1 

2 

2.30 

0.00 

12.10 

0.20 

50942 

C 

0 

4 

8 

-0.48 

0.35 

0.90 

-0.12 

50942 

D 

0 

4 

8 

-2.99 

0.93 

0.18 

-0.61 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50943 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

-0.01 

50943 

A 

1 

36 

75 

1.14 

0.24 

1.47 

0.16 

50943 

B 

0 

3 

6 

0.23 

0.67 

1.06 

-0.15 

50943 

C 

0 

3 

6 

0.85 

0.80 

1.98 

-0.03 

50943 

D 

0 

6 

13 

0.73 

0.25 

1.34 

-0.08 

50944 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

50944 

A 

1 

40 

80 

0.83 

0.19 

0.98 

0.34 

50944 

B 

0 

9 

18 

-0.02 

0.26 

1.12 

-0.24 

50944 

C 

0 

1 

2 

-2.06 

0.00 

0.10 

-0.31 

50944 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50945 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50945 

A 

1 

38 

78 

0.77 

0.20 

0.88 

0.45 

50945 

B 

0 

4 

8 

-1.39 

0.41 

0.31 

-0.43 

50945 

C 

0 

7 

14 

-0.17 

0.24 

0.94 

-0.20 

50945 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50946 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50946 

A 

1 

39 

80 

0.42 

0.18 

0.85 

0.48 

50946 

B 

0 

2 

4 

-1.61 

0.83 

0.38 

-0.27 

50946 

C 

0 

6 

12 

-0.64 

0.55 

1.52 

-0.21 

50946 

D 

0 

2 

4 

-2.26 

1.14 

0.25 

-0.37 

50947 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50947 

A 

1 

40 

82 

0.62 

0.21 

0.91 

0.44 

50947 

B 

0 

2 

4 

-1.77 

0.47 

0.22 

-0.31 

50947 

C 

0 

3 

6 

-0.20 

0.33 

1.09 

-0.10 

50947 

D 

0 

4 

8 

-1.13 

0.27 

0.43 

-0.31 

50948 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50948 

A 

1 

38 

78 

0.86 

0.20 

0.83 

0.52 

50948 

B 

0 

4 

8 

-0.47 

0.36 

0.67 

-0.17 

50948 

C 

0 

5 

10 

-0.38 

0.53 

0.93 

-0.17 

50948 

D 

0 

2 

4 

-4.33 

1.22 

0.04 

-0.62 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50949 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50949 

A 

1 

40 

82 

0.79 

0.22 

2.31 

0.30 

50949 

B 

0 

4 

8 

0.54 

0.35 

1.91 

-0.01 

50949 

C 

0 

4 

8 

-1.63 

0.30 

0.21 

-0.46 

50949 

D 

0 

1 

2 

1.46 

0.00 

4.00 

0.09 

50950 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50950 

A 

1 

43 

90 

0.55 

0.22 

0.98 

0.45 

50950 

B 

0 

1 

2 

-0.70 

0.00 

0.64 

-0.09 

50950 

C 

0 

2 

4 

-0.79 

0.77 

0.76 

-0.14 

50950 

D 

0 

2 

4 

-3.60 

1.96 

0.25 

-0.49 

50951 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50951 

A 

1 

12 

24 

1.55 

0.44 

1.11 

0.47 

50951 

B 

0 

21 

43 

0.04 

0.18 

0.79 

-0.10 

50951 

C 

0 

6 

12 

-0.17 

0.38 

0.65 

-0.09 

50951 

D 

0 

10 

20 

-0.77 

0.77 

1.15 

-0.31 

50952 

* 

-1 

4591 

96 

0.88 

0.02 

0.00 

-0.08 

50952 

A 

1 

102 

60 

1.97 

0.12 

0.92 

0.52 

50952 

B 

0 

34 

20 

0.67 

0.15 

0.76 

-0.30 

50952 

C 

0 

27 

16 

0.68 

0.17 

0.75 

-0.26 

50952 

D 

0 

7 

4 

0.17 

0.40 

0.59 

-0.20 

50953 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50953 

A 

1 

31 

63 

0.96 

0.22 

0.96 

0.38 

50953 

B 

0 

6 

12 

0.04 

0.38 

0.97 

-0.14 

50953 

C 

0 

4 

8 

0.33 

1.22 

5.07 

-0.05 

50953 

D 

0 

8 

16 

-0.50 

0.53 

1.32 

-0.33 

50954 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50954 

A 

1 

30 

61 

0.98 

0.27 

1.45 

0.26 

50954 

B 

0 

8 

16 

0.97 

0.36 

2.36 

0.09 

50954 

C 

0 

2 

4 

0.38 

0.04 

0.88 

-0.04 

50954 

D 

0 

9 

18 

-0.66 

0.69 

0.87 

-0.39 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50955 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.04 

50955 

A 

1 

14 

30 

0.92 

0.43 

1.61 

0.29 

50955 

B 

0 

4 

9 

-0.75 

0.45 

0.41 

-0.29 

50955 

C 

0 

23 

49 

0.28 

0.20 

1.19 

-0.08 

50955 

D 

0 

6 

13 

0.26 

0.22 

0.90 

-0.04 

50956 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50956 

A 

1 

33 

69 

0.76 

0.20 

0.83 

0.50 

50956 

B 

0 

2 

4 

-1.11 

0.95 

0.45 

-0.17 

50956 

C 

0 

10 

21 

0.00 

0.25 

1.22 

-0.06 

50956 

D 

0 

3 

6 

-4.37 

0.71 

0.03 

-0.72 

50957 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

50957 

A 

1 

30 

63 

1.16 

0.26 

0.97 

0.44 

50957 

B 

0 

12 

25 

0.11 

0.21 

0.95 

-0.24 

50957 

C 

0 

3 

6 

-0.66 

0.73 

0.53 

-0.25 

50957 

D 

0 

3 

6 

-0.35 

0.94 

1.14 

-0.19 

50958 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50958 

A 

1 

25 

51 

1.39 

0.23 

0.88 

0.52 

50958 

B 

0 

3 

6 

-0.68 

0.81 

0.42 

-0.33 

50958 

C 

0 

10 

20 

0.42 

0.21 

0.83 

-0.17 

50958 

D 

0 

11 

22 

0.23 

0.23 

0.76 

-0.27 

50959 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50959 

A 

1 

32 

65 

0.95 

0.27 

1.50 

0.29 

50959 

B 

0 

3 

6 

0.53 

0.20 

1.25 

-0.02 

50959 

C 

0 

7 

14 

0.61 

0.22 

1.48 

-0.01 

50959 

D 

0 

7 

14 

-0.58 

0.40 

0.62 

-0.36 

50960 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50960 

A 

1 

27 

55 

0.82 

0.26 

1.25 

0.35 

50960 

B 

0 

10 

20 

0.41 

0.23 

1.46 

0.00 

50960 

C 

0 

8 

16 

-0.57 

0.51 

0.87 

-0.33 

50960 

D 

0 

4 

8 

-0.44 

0.36 

0.60 

-0.19 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50961 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

50961 

A 

1 

42 

88 

0.72 

0.18 

0.88 

0.62 

50961 

B 

0 

2 

4 

-3.59 

2.80 

0.43 

-0.46 

50961 

C 

0 

1 

2 

-2.06 

0.00 

0.12 

-0.19 

50961 

D 

0 

3 

6 

-2.18 

1.70 

0.60 

-0.36 

50962 

* 

-1 

4484 

94 

0.88 

0.02 

0.00 

-0.07 

50962 

A 

1 

230 

83 

1.55 

0.08 

0.89 

0.44 

50962 

B 

0 

39 

14 

0.27 

0.13 

0.77 

-0.34 

50962 

C 

0 

5 

2 

-0.27 

0.22 

0.35 

-0.17 

50962 

D 

0 

3 

1 

-1.23 

0.67 

0.19 

-0.22 

50963 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

50963 

A 

1 

36 

75 

1.08 

0.19 

0.75 

0.50 

50963 

B 

0 

8 

17 

-0.28 

0.51 

1.27 

-0.33 

50963 

C 

0 

1 

2 

-0.13 

0.00 

0.63 

-0.09 

50963 

D 

0 

3 

6 

-1.01 

0.83 

0.53 

-0.33 

50964 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50964 

A 

1 

42 

88 

0.61 

0.19 

1.07 

0.14 

50964 

B 

0 

1 

2 

-1.16 

0.00 

0.28 

-0.21 

50964 

C 

0 

5 

10 

0.37 

0.40 

1.79 

-0.05 

50964 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50965 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50965 

A 

1 

45 

94 

0.56 

0.16 

0.95 

0.25 

50965 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50965 

C 

0 

1 

2 

0.76 

0.00 

1.98 

0.04 

50965 

D 

0 

2 

4 

-1.17 

0.61 

0.34 

-0.32 

50966 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.06 

50966 

A 

1 

42 

86 

0.42 

0.21 

0.83 

0.55 

50966 

B 

0 

1 

2 

-1.06 

0.00 

0.54 

-0.10 

50966 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50966 

D 

0 

6 

12 

-2.32 

0.72 

0.36 

-0.54 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50967 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50967 

A 

1 

43 

88 

0.94 

0.22 

0.71 

0.52 

50967 

B 

0 

1 

2 

0.41 

0.00 

1.83 

-0.02 

50967 

C 

0 

1 

2 

-1.10 

0.00 

0.40 

-0.15 

50967 

D 

0 

4 

8 

-2.43 

0.83 

0.23 

-0.54 

50968 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50968 

A 

1 

39 

80 

0.75 

0.26 

1.03 

0.30 

50968 

B 

0 

1 

2 

-1.97 

0.00 

0.18 

-0.20 

50968 

C 

0 

7 

14 

0.56 

0.53 

3.89 

0.02 

50968 

D 

0 

2 

4 

-3.77 

0.66 

0.04 

-0.49 

50969 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50969 

A 

1 

27 

55 

0.70 

0.22 

0.89 

0.38 

50969 

B 

0 

14 

29 

-0.25 

0.23 

1.09 

-0.29 

50969 

C 

0 

6 

12 

0.50 

0.41 

2.49 

0.07 

50969 

D 

0 

2 

4 

-2.01 

1.10 

0.19 

-0.40 

50970 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50970 

A 

1 

47 

98 

0.46 

0.20 

0.83 

0.36 

50970 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50970 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50970 

D 

0 

1 

2 

-3.11 

0.00 

0.08 

-0.36 

50971 

* 

-1 

4694 

99 

0.90 

0.02 

0.00 

0.00 

50971 

A 

1 

63 

94 

1.09 

0.19 

0.82 

0.38 

50971 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50971 

C 

0 

1 

1 

-0.02 

0.00 

0.97 

-0.07 

50971 

D 

0 

3 

4 

-1.97 

0.35 

0.16 

-0.40 

50972 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.00 

50972 

A 

1 

48 

98 

0.98 

0.19 

0.95 

0.23 

50972 

B 

0 

1 

2 

-1.21 

0.00 

0.24 

-0.23 

50972 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50972 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50973 

* 

-1 

4694 

99 

0.90 

0.02 

0.00 

-0.01 

50973 

A 

1 

58 

87 

1.35 

0.17 

0.73 

0.55 

50973 

B 

0 

3 

4 

-0.78 

0.29 

0.36 

-0.26 

50973 

C 

0 

1 

1 

-1.37 

0.00 

0.18 

-0.20 

50973 

D 

0 

5 

7 

-1.21 

0.57 

0.37 

-0.42 

50974 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50974 

A 

1 

40 

82 

1.09 

0.18 

0.83 

0.46 

50974 

B 

0 

3 

6 

-0.82 

0.45 

0.37 

-0.31 

50974 

C 

0 

4 

8 

0.73 

0.34 

1.66 

-0.02 

50974 

D 

0 

2 

4 

-2.53 

1.47 

0.12 

-0.51 

50975 

* 

-1 

4715 

99 

0.91 

0.02 

0.00 

0.03 

50975 

A 

1 

32 

70 

0.90 

0.23 

0.93 

0.41 

50975 

B 

0 

2 

4 

0.26 

0.30 

1.13 

-0.04 

50975 

C 

0 

8 

17 

0.01 

0.34 

1.52 

-0.18 

50975 

D 

0 

4 

9 

-1.17 

0.45 

0.35 

-0.40 

50976 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

50976 

A 

1 

27 

55 

0.39 

0.26 

1.64 

0.14 

50976 

B 

0 

6 

12 

-0.02 

0.48 

1.26 

-0.08 

50976 

C 

0 

7 

14 

-0.05 

0.30 

1.08 

-0.10 

50976 

D 

0 

9 

18 

0.16 

0.40 

1.77 

-0.03 

50977 

* 

-1 

4694 

99 

0.90 

0.02 

0.00 

-0.03 

50977 

A 

1 

38 

57 

1.67 

0.23 

1.32 

0.36 

50977 

B 

0 

23 

34 

0.92 

0.21 

1.57 

-0.16 

50977 

C 

0 

5 

7 

-0.37 

0.59 

0.42 

-0.32 

50977 

D 

0 

1 

1 

-0.46 

0.00 

0.23 

-0.15 

50978 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50978 

A 

1 

30 

61 

0.88 

0.16 

0.80 

0.49 

50978 

B 

0 

7 

14 

-0.13 

0.34 

0.82 

-0.21 

50978 

C 

0 

7 

14 

0.07 

0.28 

0.92 

-0.14 

50978 

D 

0 

5 

10 

-0.84 

0.83 

0.62 

-0.39 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50979 

* 

-1 

4693 

99 

0.90 

0.02 

0.00 

0.01 

50979 

A 

1 

51 

75 

1.03 

0.19 

1.02 

0.31 

50979 

B 

0 

8 

12 

0.79 

0.40 

2.73 

0.00 

50979 

C 

0 

7 

10 

-0.35 

0.36 

0.76 

-0.28 

50979 

D 

0 

2 

3 

-1.66 

0.84 

0.18 

-0.31 

50980 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50980 

A 

1 

35 

73 

0.69 

0.23 

1.09 

0.33 

50980 

B 

0 

6 

13 

-0.69 

0.34 

0.66 

-0.30 

50980 

C 

0 

5 

10 

0.07 

0.76 

4.47 

-0.09 

50980 

D 

0 

2 

4 

-0.19 

0.91 

1.17 

-0.09 

50981 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50981 

A 

1 

15 

31 

1.21 

0.31 

1.49 

0.36 

50981 

B 

0 

13 

27 

0.57 

0.21 

1.00 

-0.02 

50981 

C 

0 

15 

31 

0.39 

0.26 

1.10 

-0.14 

50981 

D 

0 

6 

12 

-0.24 

0.48 

0.56 

-0.29 

50982 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.02 

50982 

A 

1 

41 

84 

1.02 

0.19 

0.68 

0.59 

50982 

B 

0 

1 

2 

-0.38 

0.00 

0.66 

-0.09 

50982 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50982 

D 

0 

7 

14 

-1.61 

0.70 

0.68 

-0.58 

50983 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

-0.01 

50983 

A 

1 

55 

87 

1.35 

0.19 

0.98 

0.46 

50983 

B 

0 

2 

3 

-0.11 

0.62 

0.65 

-0.13 

50983 

C 

0 

2 

3 

-0.56 

1.04 

0.54 

-0.18 

50983 

D 

0 

4 

6 

-1.47 

1.38 

0.59 

-0.40 

50984 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50984 

A 

1 

11 

22 

1.45 

0.40 

1.43 

0.32 

50984 

B 

0 

17 

35 

0.78 

0.27 

1.48 

0.00 

50984 

C 

0 

9 

18 

0.20 

0.18 

0.47 

-0.24 

50984 

D 

0 

12 

24 

0.59 

0.35 

1.22 

-0.09 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50985 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

50985 

A 

1 

11 

22 

1.43 

0.67 

2.72 

0.31 

50985 

B 

0 

15 

31 

0.82 

0.22 

1.53 

0.09 

50985 

C 

0 

12 

24 

0.61 

0.22 

1.08 

-0.01 

50985 

D 

0 

11 

22 

-0.39 

0.29 

0.45 

-0.40 

50986 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.04 

50986 

A 

1 

8 

17 

0.54 

0.30 

1.40 

0.11 

50986 

B 

0 

2 

4 

0.02 

0.27 

0.60 

-0.08 

50986 

C 

0 

18 

38 

0.19 

0.23 

1.01 

-0.13 

50986 

D 

0 

19 

40 

0.41 

0.20 

1.26 

0.08 

50987 

* 

-1 

4715 

99 

0.91 

0.02 

0.00 

0.04 

50987 

A 

1 

39 

85 

0.72 

0.21 

0.82 

0.49 

50987 

B 

0 

1 

2 

-1.13 

0.00 

0.38 

-0.16 

50987 

C 

0 

1 

2 

-1.05 

0.00 

0.41 

-0.15 

50987 

D 

0 

5 

11 

-1.36 

0.73 

0.59 

-0.42 

50988 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.00 

50988 

A 

1 

23 

40 

1.71 

0.28 

0.95 

0.50 

50988 

B 

0 

7 

12 

0.47 

0.33 

0.81 

-0.13 

50988 

C 

0 

24 

42 

0.23 

0.21 

1.14 

-0.44 

50988 

D 

0 

3 

5 

1.31 

0.57 

2.02 

0.07 

50989 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

50989 

A 

1 

16 

33 

1.29 

0.34 

1.29 

0.34 

50989 

B 

0 

21 

43 

0.66 

0.22 

1.29 

-0.04 

50989 

C 

0 

2 

4 

0.91 

0.10 

1.04 

0.03 

50989 

D 

0 

10 

20 

-0.14 

0.29 

0.54 

-0.37 

50990 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50990 

A 

1 

17 

35 

0.85 

0.40 

1.60 

0.27 

50990 

B 

0 

9 

19 

-0.30 

0.43 

1.21 

-0.24 

50990 

C 

0 

12 

25 

0.76 

0.30 

2.36 

0.17 

50990 

D 

0 

10 

21 

-0.30 

0.16 

0.55 

-0.26 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50991 

* 

-1 

4697 

99 

0.90 

0.02 

0.00 

0.01 

50991 

A 

1 

32 

50 

1.61 

0.27 

1.02 

0.50 

50991 

B 

0 

9 

14 

0.02 

0.37 

0.80 

-0.20 

50991 

C 

0 

11 

17 

0.55 

0.22 

1.05 

-0.07 

50991 

D 

0 

12 

19 

-0.53 

0.49 

0.52 

-0.40 

50992 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

50992 

A 

1 

23 

48 

0.98 

0.23 

0.93 

0.49 

50992 

B 

0 

6 

13 

0.06 

0.33 

0.95 

-0.09 

50992 

C 

0 

10 

21 

0.04 

0.22 

0.85 

-0.13 

50992 

D 

0 

9 

19 

-0.70 

0.50 

0.62 

-0.41 

50993 

* 

-1 

4699 

99 

0.90 

0.02 

0.00 

0.00 

50993 

A 

1 

40 

65 

1.41 

0.20 

0.85 

0.48 

50993 

B 

0 

5 

8 

0.28 

0.36 

0.89 

-0.14 

50993 

C 

0 

13 

21 

0.00 

0.24 

0.75 

-0.36 

50993 

D 

0 

4 

6 

0.01 

0.93 

2.01 

-0.18 

50994 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

50994 

A 

1 

32 

63 

0.88 

0.22 

1.14 

0.37 

50994 

B 

0 

7 

14 

-0.17 

0.33 

0.79 

-0.24 

50994 

C 

0 

5 

10 

0.32 

0.36 

1.18 

-0.06 

50994 

D 

0 

7 

14 

-0.16 

0.44 

1.10 

-0.23 

50995 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

50995 

A 

1 

43 

90 

0.53 

0.18 

1.03 

0.20 

50995 

B 

0 

2 

4 

-0.02 

1.15 

1.68 

-0.09 

50995 

C 

0 

1 

2 

0.59 

0.00 

1.79 

0.02 

50995 

D 

0 

2 

4 

-0.85 

0.16 

0.43 

-0.24 

50996 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.02 

50996 

A 

1 

44 

83 

1.02 

0.17 

0.80 

0.59 

50996 

B 

0 

3 

6 

-0.90 

0.21 

0.31 

-0.25 

50996 

C 

0 

3 

6 

-0.83 

0.50 

0.42 

-0.24 

50996 

D 

0 

3 

6 

-2.19 

1.76 

0.63 

-0.47 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50997 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

50997 

A 

1 

19 

39 

1.08 

0.28 

1.03 

0.42 

50997 

B 

0 

5 

10 

-0.40 

0.42 

0.53 

-0.28 

50997 

C 

0 

21 

43 

0.27 

0.18 

0.99 

-0.19 

50997 

D 

0 

4 

8 

0.20 

0.33 

0.81 

-0.08 

50998 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.02 

50998 

A 

1 

33 

65 

1.33 

0.24 

0.91 

0.52 

50998 

B 

0 

2 

4 

0.35 

0.53 

0.98 

-0.04 

50998 

C 

0 

5 

10 

-0.54 

0.32 

0.43 

-0.25 

50998 

D 

0 

11 

22 

-0.57 

0.58 

0.91 

-0.40 

50999 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

50999 

A 

1 

38 

78 

0.67 

0.16 

0.84 

0.47 

50999 

B 

0 

7 

14 

-0.46 

0.40 

0.97 

-0.30 

50999 

C 

0 

2 

4 

-0.65 

0.07 

0.48 

-0.19 

50999 

D 

0 

2 

4 

-1.09 

1.53 

0.75 

-0.27 

51000 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

-0.01 

51000 

A 

1 

45 

71 

1.57 

0.20 

0.90 

0.50 

51000 

B 

0 

9 

14 

0.46 

0.27 

0.93 

-0.15 

51000 

C 

0 

5 

8 

-0.50 

0.37 

0.35 

-0.29 

51000 

D 

0 

4 

6 

-1.28 

1.57 

0.93 

-0.38 

51001 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

51001 

A 

1 

45 

92 

0.73 

0.18 

0.96 

0.20 

51001 

B 

0 

1 

2 

-1.45 

0.00 

0.22 

-0.25 

51001 

C 

0 

3 

6 

0.26 

0.98 

2.48 

-0.08 

51001 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

51002 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

51002 

A 

1 

38 

78 

0.59 

0.18 

0.95 

0.39 

51002 

B 

0 

3 

6 

0.15 

0.89 

2.60 

-0.04 

51002 

C 

0 

3 

6 

-0.69 

0.98 

1.13 

-0.21 

51002 

D 

0 

5 

10 

-0.92 

0.54 

0.77 

-0.34 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51003 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

51003 

A 

1 

42 

81 

0.54 

0.18 

1.35 

-0.07 

51003 

B 

0 

6 

12 

1.17 

0.37 

3.32 

0.18 

51003 

C 

0 

3 

6 

0.59 

0.99 

3.23 

0.00 

51003 

D 

0 

1 

2 

-1.16 

0.00 

0.25 

-0.21 

51004 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

51004 

A 

1 

31 

62 

0.99 

0.19 

1.21 

0.27 

51004 

B 

0 

13 

26 

0.47 

0.24 

1.19 

-0.17 

51004 

C 

0 

5 

10 

0.35 

0.46 

1.26 

-0.14 

51004 

D 

0 

1 

2 

-0.02 

0.00 

0.51 

-0.11 

51005 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

51005 

A 

1 

22 

44 

0.49 

0.27 

1.33 

0.23 

51005 

B 

0 

19 

38 

0.24 

0.21 

1.47 

0.02 

51005 

C 

0 

4 

8 

-0.16 

0.33 

0.78 

-0.10 

51005 

D 

0 

5 

10 

-0.90 

0.47 

0.50 

-0.33 

51006 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

51006 

A 

1 

29 

59 

1.02 

0.20 

0.85 

0.45 

51006 

B 

0 

11 

22 

-0.41 

0.33 

0.86 

-0.40 

51006 

C 

0 

5 

10 

0.43 

0.46 

1.47 

-0.03 

51006 

D 

0 

4 

8 

-0.18 

1.04 

1.68 

-0.17 

51007 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.02 

51007 

A 

1 

37 

69 

1.02 

0.21 

0.98 

0.40 

51007 

B 

0 

13 

24 

0.01 

0.37 

2.03 

-0.27 

51007 

C 

0 

1 

2 

-1.11 

0.00 

0.23 

-0.18 

51007 

D 

0 

3 

6 

-0.42 

0.20 

0.48 

-0.20 

51008 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

-0.01 

51008 

A 

1 

31 

63 

1.34 

0.20 

0.99 

0.42 

51008 

B 

0 

8 

16 

0.65 

0.23 

1.01 

-0.14 

51008 

C 

0 

7 

14 

0.13 

0.41 

0.76 

-0.32 

51008 

D 

0 

3 

6 

0.27 

0.32 

0.62 

-0.17 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51009 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

51009 

A 

1 

31 

63 

0.94 

0.22 

1.02 

0.45 

51009 

B 

0 

7 

14 

-0.27 

0.47 

0.89 

-0.16 

51009 

C 

0 

7 

14 

0.10 

0.33 

1.04 

-0.07 

51009 

D 

0 

4 

8 

-2.34 

1.58 

1.30 

-0.50 

51010 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

51010 

A 

1 

26 

50 

1.04 

0.22 

1.03 

0.36 

51010 

B 

0 

10 

19 

0.93 

0.30 

2.09 

0.13 

51010 

C 

0 

13 

25 

-0.08 

0.26 

0.75 

-0.29 

51010 

D 

0 

3 

6 

-1.81 

1.10 

0.19 

-0.46 

51011 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

51011 

A 

1 

35 

67 

1.03 

0.21 

1.07 

0.42 

51011 

B 

0 

11 

21 

0.46 

0.27 

1.55 

-0.05 

51011 

C 

0 

3 

6 

-0.75 

0.20 

0.34 

-0.22 

51011 

D 

0 

3 

6 

-2.75 

1.18 

0.16 

-0.55 

51012 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

51012 

A 

1 

21 

39 

1.22 

0.28 

0.92 

0.44 

51012 

B 

0 

17 

31 

0.32 

0.33 

1.84 

-0.03 

51012 

C 

0 

7 

13 

-0.22 

0.28 

0.59 

-0.15 

51012 

D 

0 

9 

17 

-0.99 

0.59 

0.41 

-0.41 

51013 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.01 

51013 

A 

1 

33 

61 

1.30 

0.19 

1.02 

0.45 

51013 

B 

0 

9 

17 

0.59 

0.32 

1.18 

-0.07 

51013 

C 

0 

9 

17 

0.10 

0.18 

0.58 

-0.23 

51013 

D 

0 

3 

6 

-1.91 

1.82 

0.42 

-0.48 

51014 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

51014 

A 

1 

43 

86 

0.62 

0.18 

0.91 

0.51 

51014 

B 

0 

1 

2 

0.66 

0.00 

2.50 

0.03 

51014 

C 

0 

2 

4 

-0.96 

0.09 

0.50 

-0.18 

51014 

D 

0 

4 

8 

-2.43 

1.11 

0.43 

-0.55 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51015 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.00 

51015 

A 

-1 

54 

100 

0.90 

0.16 

0.00 

0.00 

51015 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

51015 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

51015 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

51016 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

51016 

A 

1 

39 

71 

1.12 

0.21 

0.95 

0.48 

51016 

B 

0 

7 

13 

0.21 

0.38 

1.48 

-0.10 

51016 

C 

0 

3 

5 

-1.28 

0.73 

0.32 

-0.29 

51016 

D 

0 

6 

11 

-1.10 

0.95 

0.76 

-0.38 

51017 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

51017 

A 

1 

31 

61 

0.80 

0.18 

0.97 

0.40 

51017 

B 

0 

13 

25 

0.24 

0.25 

1.37 

-0.13 

51017 

C 

0 

5 

10 

-0.56 

0.37 

0.50 

-0.33 

51017 

D 

0 

2 

4 

-0.62 

0.51 

0.43 

-0.21 

51018 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.05 

51018 

A 

1 

33 

65 

0.69 

0.25 

1.41 

0.32 

51018 

B 

0 

11 

22 

0.29 

0.25 

1.48 

-0.01 

51018 

C 

0 

1 

2 

0.57 

0.00 

1.47 

0.02 

51018 

D 

0 

6 

12 

-1.81 

1.00 

0.60 

-0.47 

51019 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

51019 

A 

1 

36 

65 

1.08 

0.19 

1.07 

0.43 

51019 

B 

0 

14 

25 

0.21 

0.19 

0.87 

-0.23 

51019 

C 

0 

3 

5 

0.14 

0.40 

0.76 

-0.11 

51019 

D 

0 

2 

4 

-1.95 

2.04 

0.32 

-0.42 

51020 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.04 

51020 

A 

1 

51 

94 

0.56 

0.17 

1.07 

0.32 

51020 

B 

0 

1 

2 

0.68 

0.00 

1.92 

0.02 

51020 

C 

0 

1 

2 

0.68 

0.00 

1.91 

0.02 

51020 

D 

0 

1 

2 

-5.56 

0.00 

0.00 

-0.58 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51021 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

51021 

A 

1 

41 

77 

0.80 

0.20 

1.28 

0.31 

51021 

B 

0 

2 

4 

1.04 

1.64 

6.10 

0.07 

51021 

C 

0 

3 

6 

-0.45 

0.80 

0.86 

-0.18 

51021 

D 

0 

7 

13 

-0.48 

0.61 

0.88 

-0.30 

51022 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.05 

51022 

A 

1 

43 

77 

0.59 

0.21 

1.22 

0.29 

51022 

B 

0 

2 

4 

-1.21 

0.36 

0.31 

-0.20 

51022 

C 

0 

2 

4 

-0.41 

0.16 

0.65 

-0.09 

51022 

D 

0 

9 

16 

-0.31 

0.75 

2.91 

-0.19 

51023 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

51023 

A 

1 

36 

73 

0.74 

0.22 

1.08 

0.26 

51023 

B 

0 

3 

6 

0.10 

0.45 

1.06 

-0.08 

51023 

C 

0 

2 

4 

0.10 

0.91 

1.28 

-0.07 

51023 

D 

0 

8 

16 

-0.15 

0.59 

1.23 

-0.22 

51024 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

-0.01 

51024 

A 

1 

46 

84 

1.28 

0.21 

1.09 

0.32 

51024 

B 

0 

3 

5 

-0.66 

0.82 

0.58 

-0.27 

51024 

C 

0 

1 

2 

2.76 

0.00 

10.76 

0.15 

51024 

D 

0 

5 

9 

-0.22 

0.51 

0.89 

-0.27 

51025 

* 

-1 

4695 

99 

0.90 

0.02 

0.00 

-0.02 

51025 

A 

1 

33 

50 

1.44 

0.23 

1.28 

0.25 

51025 

B 

0 

5 

8 

0.77 

0.28 

0.91 

-0.07 

51025 

C 

0 

22 

33 

1.02 

0.22 

1.69 

-0.05 

51025 

D 

0 

6 

9 

-0.05 

0.82 

0.77 

-0.28 

51026 

* 

-1 

4704 

99 

0.91 

0.02 

0.00 

0.02 

51026 

A 

1 

33 

58 

1.12 

0.22 

1.08 

0.44 

51026 

B 

0 

11 

19 

0.06 

0.32 

1.08 

-0.21 

51026 

C 

0 

4 

7 

0.00 

0.37 

0.75 

-0.13 

51026 

D 

0 

9 

16 

-0.23 

0.51 

0.79 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51027 

* 

-1 

4703 

99 

0.91 

0.02 

0.00 

0.03 

51027 

A 

1 

23 

40 

1.39 

0.30 

0.98 

0.52 

51027 

B 

0 

17 

29 

-0.01 

0.19 

0.75 

-0.31 

51027 

C 

0 

9 

16 

0.15 

0.25 

0.88 

-0.15 

51027 

D 

0 

9 

16 

0.12 

0.28 

0.84 

-0.16 

51028 

* 

-1 

4694 

99 

0.90 

0.02 

0.00 

-0.02 

51028 

A 

1 

33 

49 

1.89 

0.19 

0.76 

0.59 

51028 

B 

0 

26 

39 

0.55 

0.17 

0.82 

-0.38 

51028 

C 

0 

3 

4 

-0.56 

0.98 

0.46 

-0.30 

51028 

D 

0 

5 

7 

0.38 

0.33 

0.59 

-0.18 

51029 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.02 

51029 

A 

1 

28 

50 

1.13 

0.19 

0.94 

0.48 

51029 

B 

0 

20 

36 

0.16 

0.22 

0.94 

-0.34 

51029 

C 

0 

6 

11 

-0.06 

0.22 

0.58 

-0.23 

51029 

D 

0 

2 

4 

0.42 

0.33 

0.86 

-0.04 

51030 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.06 

51030 

A 

1 

24 

46 

0.70 

0.25 

1.07 

0.42 

51030 

B 

0 

20 

38 

-0.18 

0.18 

0.93 

-0.26 

51030 

C 

0 

6 

12 

-0.52 

0.39 

0.75 

-0.23 

51030 

D 

0 

2 

4 

-0.21 

0.62 

0.81 

-0.07 

51031 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

51031 

A 

1 

21 

42 

0.76 

0.25 

1.09 

0.44 

51031 

B 

0 

21 

42 

-0.21 

0.15 

0.77 

-0.36 

51031 

C 

0 

3 

6 

0.82 

0.55 

2.39 

0.14 

51031 

D 

0 

5 

10 

-0.57 

0.39 

0.57 

-0.26 

51032 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.02 

51032 

A 

1 

27 

52 

1.24 

0.21 

0.91 

0.47 

51032 

B 

0 

19 

37 

0.26 

0.23 

1.16 

-0.18 

51032 

C 

0 

1 

2 

-0.31 

0.00 

0.38 

-0.09 

51032 

D 

0 

5 

10 

-1.47 

1.07 

0.41 

-0.47 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51033 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.01 

51033 

A 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

51033 

B 

-1 

33 

65 

1.01 

0.22 

0.00 

0.21 

51033 

C 

-1 

6 

12 

0.83 

0.70 

0.00 

0.00 

51033 

D 

-1 

12 

24 

0.27 

0.29 

0.00 

-0.24 

51034 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.01 

51034 

A 

1 

7 

13 

0.97 

0.48 

2.41 

0.06 

51034 

B 

0 

6 

11 

1.45 

0.48 

2.30 

0.17 

51034 

C 

0 

25 

45 

0.60 

0.19 

0.76 

-0.10 

51034 

D 

0 

17 

31 

0.67 

0.50 

1.46 

-0.04 

51035 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

51035 

A 

1 

22 

42 

1.19 

0.21 

0.85 

0.56 

51035 

B 

0 

9 

17 

0.02 

0.28 

0.77 

-0.20 

51035 

C 

0 

11 

21 

-0.46 

0.18 

0.43 

-0.47 

51035 

D 

0 

11 

21 

0.42 

0.23 

1.27 

-0.03 

51036 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

51036 

A 

1 

7 

14 

0.96 

0.67 

2.84 

0.17 

51036 

B 

0 

16 

32 

0.53 

0.24 

1.11 

0.02 

51036 

C 

0 

9 

18 

0.39 

0.44 

0.96 

-0.04 

51036 

D 

0 

18 

36 

0.35 

0.20 

0.80 

-0.10 

51037 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

51037 

A 

1 

37 

70 

0.64 

0.18 

1.01 

0.31 

51037 

B 

0 

1 

2 

-0.81 

0.00 

0.37 

-0.13 

51037 

C 

0 

14 

26 

0.13 

0.29 

1.46 

-0.13 

51037 

D 

0 

1 

2 

-3.99 

0.00 

0.02 

-0.49 

51038 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.06 

51038 

A 

1 

39 

83 

0.26 

0.19 

1.14 

0.20 

51038 

B 

0 

3 

6 

-0.50 

0.14 

0.74 

-0.15 

51038 

C 

0 

3 

6 

-0.25 

0.27 

0.99 

-0.10 

51038 

D 

0 

2 

4 

-0.16 

0.44 

1.10 

-0.06 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51039 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

51039 

A 

1 

9 

18 

1.24 

0.43 

1.46 

0.33 

51039 

B 

0 

6 

12 

0.32 

0.36 

0.82 

-0.05 

51039 

C 

0 

12 

24 

0.05 

0.32 

0.81 

-0.22 

51039 

D 

0 

22 

45 

0.42 

0.21 

1.17 

-0.04 

51040 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

51040 

A 

1 

6 

12 

1.03 

1.03 

4.12 

0.16 

51040 

B 

0 

8 

16 

0.32 

0.31 

0.94 

-0.05 

51040 

C 

0 

6 

12 

0.11 

0.47 

0.83 

-0.10 

51040 

D 

0 

29 

59 

0.45 

0.22 

1.29 

-0.01 

51041 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.03 

51041 

A 

1 

13 

25 

0.75 

0.30 

1.98 

0.13 

51041 

B 

0 

16 

30 

0.41 

0.27 

1.07 

-0.04 

51041 

C 

0 

4 

8 

0.47 

0.65 

1.17 

0.00 

51041 

D 

0 

20 

38 

0.36 

0.32 

1.22 

-0.08 

51042 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

51042 

A 

1 

10 

20 

0.94 

0.49 

1.57 

0.23 

51042 

B 

0 

13 

26 

-0.04 

0.20 

0.65 

-0.25 

51042 

C 

0 

7 

14 

0.40 

0.31 

0.93 

-0.01 

51042 

D 

0 

20 

40 

0.48 

0.25 

1.68 

0.04 

51043 

* 

-1 

4700 

99 

0.91 

0.02 

0.00 

0.03 

51043 

A 

1 

10 

16 

0.37 

0.33 

2.76 

-0.06 

51043 

B 

0 

10 

16 

1.01 

0.32 

1.74 

0.19 

51043 

C 

0 

12 

20 

0.32 

0.39 

1.06 

-0.09 

51043 

D 

0 

29 

48 

0.49 

0.20 

1.20 

-0.03 

51044 

* 

-1 

4697 

99 

0.90 

0.02 

0.00 

-0.01 

51044 

A 

1 

19 

30 

1.77 

0.32 

1.91 

0.39 

51044 

B 

0 

21 

33 

1.07 

0.21 

1.21 

0.05 

51044 

C 

0 

4 

6 

0.40 

0.51 

0.55 

-0.11 

51044 

D 

0 

20 

31 

0.22 

0.29 

0.76 

-0.38 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51045 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.07 

51045 

A 

1 

11 

21 

0.58 

0.35 

1.32 

0.27 

51045 

B 

0 

25 

48 

0.07 

0.21 

1.23 

0.08 

51045 

C 

0 

1 

2 

0.82 

0.00 

1.67 

0.10 

51045 

D 

0 

15 

29 

-0.69 

0.32 

0.60 

-0.36 

51046 

* 

-1 

4714 

99 

0.90 

0.02 

0.00 

0.02 

51046 

A 

1 

19 

40 

1.56 

0.38 

1.01 

0.55 

51046 

B 

0 

17 

36 

0.25 

0.15 

0.87 

-0.22 

51046 

C 

0 

6 

13 

-0.21 

0.28 

0.55 

-0.24 

51046 

D 

0 

5 

11 

-0.37 

0.32 

0.45 

-0.26 

51047 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.01 

51047 

A 

1 

29 

56 

1.26 

0.25 

1.03 

0.48 

51047 

B 

0 

12 

23 

0.08 

0.20 

0.76 

-0.29 

51047 

C 

0 

5 

10 

-0.09 

0.35 

0.69 

-0.21 

51047 

D 

0 

6 

12 

0.14 

0.29 

0.89 

-0.17 

51048 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

51048 

A 

1 

28 

58 

0.96 

0.25 

0.99 

0.40 

51048 

B 

0 

8 

17 

0.02 

0.22 

0.87 

-0.20 

51048 

C 

0 

8 

17 

-0.19 

0.30 

0.82 

-0.28 

51048 

D 

0 

4 

8 

0.24 

0.31 

1.03 

-0.08 

51049 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.03 

51049 

A 

1 

14 

30 

0.83 

0.34 

1.57 

0.18 

51049 

B 

0 

13 

28 

0.61 

0.26 

1.40 

0.05 

51049 

C 

0 

11 

23 

0.48 

0.25 

1.00 

-0.02 

51049 

D 

0 

9 

19 

-0.02 

0.41 

0.85 

-0.25 

51050 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.01 

51050 

A 

1 

19 

36 

1.53 

0.32 

1.18 

0.52 

51050 

B 

0 

14 

26 

0.52 

0.19 

0.97 

-0.12 

51050 

C 

0 

12 

23 

0.38 

0.17 

0.80 

-0.18 

51050 

D 

0 

8 

15 

-0.15 

0.21 

0.46 

-0.33 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51051 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.01 

51051 

A 

1 

50 

88 

1.05 

0.16 

1.22 

0.44 

51051 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

51051 

C 

0 

4 

7 

0.15 

0.12 

0.73 

-0.13 

51051 

D 

0 

3 

5 

-2.22 

1.67 

0.35 

-0.50 

51052 

* 

-1 

4714 

99 

0.90 

0.02 

0.00 

0.02 

51052 

A 

1 

33 

70 

1.02 

0.22 

0.96 

0.41 

51052 

B 

0 

2 

4 

0.12 

0.09 

0.76 

-0.10 

51052 

C 

0 

9 

19 

-0.35 

0.25 

0.62 

-0.41 

51052 

D 

0 

3 

6 

0.53 

0.21 

1.20 

-0.03 

51053 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

51053 

A 

1 

37 

77 

0.77 

0.20 

0.95 

0.41 

51053 

B 

0 

4 

8 

0.03 

0.99 

4.33 

-0.08 

51053 

C 

0 

4 

8 

-0.08 

0.51 

1.13 

-0.10 

51053 

D 

0 

3 

6 

-2.64 

1.52 

0.34 

-0.51 

51054 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

51054 

A 

1 

40 

77 

0.71 

0.21 

1.10 

0.48 

51054 

B 

0 

3 

6 

-1.11 

0.68 

0.45 

-0.23 

51054 

C 

0 

5 

10 

-0.47 

0.41 

0.88 

-0.16 

51054 

D 

0 

4 

8 

-1.70 

1.29 

0.66 

-0.37 

51055 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.04 

51055 

A 

1 

45 

85 

0.63 

0.19 

1.00 

0.45 

51055 

B 

0 

5 

9 

-0.36 

0.29 

0.90 

-0.15 

51055 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

51055 

D 

0 

3 

6 

-2.83 

1.37 

0.25 

-0.51 

51056 

* 

-1 

4715 

99 

0.91 

0.02 

0.00 

0.06 

51056 

A 

1 

29 

63 

0.88 

0.26 

1.16 

0.51 

51056 

B 

0 

5 

11 

0.45 

0.54 

2.34 

0.06 

51056 

C 

0 

5 

11 

-0.84 

0.22 

0.43 

-0.18 

51056 

D 

0 

7 

15 

-2.44 

0.95 

0.41 

-0.57 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51057 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.02 

51057 

A 

1 

42 

79 

0.91 

0.16 

0.83 

0.55 

51057 

B 

0 

2 

4 

-0.49 

0.14 

0.47 

-0.19 

51057 

C 

0 

8 

15 

-0.72 

0.19 

0.41 

-0.50 

51057 

D 

0 

1 

2 

0.18 

0.00 

0.91 

-0.05 

51058 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

51058 

A 

1 

38 

75 

0.87 

0.16 

0.78 

0.60 

51058 

B 

0 

2 

4 

-0.48 

0.15 

0.50 

-0.17 

51058 

C 

0 

7 

14 

-0.70 

0.32 

0.49 

-0.42 

51058 

D 

0 

4 

8 

-0.68 

0.33 

0.49 

-0.30 

51059 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

0.01 

51059 

A 

1 

50 

79 

1.27 

0.14 

0.71 

0.66 

51059 

B 

0 

4 

6 

-0.53 

0.72 

0.72 

-0.22 

51059 

C 

0 

6 

10 

-0.78 

0.17 

0.32 

-0.33 

51059 

D 

0 

3 

5 

-2.99 

1.35 

0.15 

-0.55 

51060 

* 

-1 

4714 

99 

0.90 

0.02 

0.00 

0.00 

51060 

A 

1 

40 

85 

1.11 

0.16 

0.82 

0.51 

51060 

B 

0 

1 

2 

-0.87 

0.00 

0.26 

-0.22 

51060 

C 

0 

5 

11 

-0.13 

0.24 

0.62 

-0.30 

51060 

D 

0 

1 

2 

-2.36 

0.00 

0.06 

-0.41 

51061 

* 

-1 

4697 

99 

0.90 

0.02 

0.00 

0.02 

51061 

A 

1 

39 

61 

1.14 

0.21 

0.99 

0.41 

51061 

B 

0 

5 

8 

-0.06 

0.28 

0.68 

-0.17 

51061 

C 

0 

17 

27 

0.13 

0.31 

1.55 

-0.27 

51061 

D 

0 

3 

5 

-0.23 

0.51 

0.63 

-0.16 

51062 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.02 

51062 

A 

1 

31 

60 

1.21 

0.23 

1.08 

0.47 

51062 

B 

0 

11 

21 

0.02 

0.29 

0.94 

-0.27 

51062 

C 

0 

3 

6 

-0.62 

0.91 

0.56 

-0.25 

51062 

D 

0 

7 

13 

0.07 

0.32 

0.80 

-0.19 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51063 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

51063 

A 

1 

30 

61 

1.40 

0.30 

0.71 

0.57 

51063 

B 

0 

6 

12 

-0.86 

0.36 

0.47 

-0.33 

51063 

C 

0 

8 

16 

-0.31 

0.43 

1.08 

-0.24 

51063 

D 

0 

5 

10 

-0.69 

0.31 

0.54 

-0.26 

51064 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

51064 

A 

1 

42 

84 

0.99 

0.21 

1.00 

0.26 

51064 

B 

0 

2 

4 

0.24 

1.03 

1.44 

-0.09 

51064 

C 

0 

3 

6 

0.94 

0.45 

2.23 

0.02 

51064 

D 

0 

3 

6 

-1.11 

1.47 

0.75 

-0.34 

51065 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.00 

51065 

A 

1 

42 

84 

1.26 

0.18 

0.85 

0.52 

51065 

B 

0 

4 

8 

-0.78 

0.60 

0.46 

-0.38 

51065 

C 

0 

1 

2 

-0.43 

0.00 

0.43 

-0.15 

51065 

D 

0 

3 

6 

-0.57 

0.71 

0.53 

-0.29 

51066 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

-0.02 

51066 

A 

1 

40 

75 

1.38 

0.21 

1.04 

0.35 

51066 

B 

0 

1 

2 

-0.46 

0.00 

0.32 

-0.16 

51066 

C 

0 

6 

11 

0.82 

0.28 

1.39 

-0.08 

51066 

D 

0 

6 

11 

-0.12 

0.41 

0.71 

-0.33 

51067 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

51067 

A 

1 

42 

88 

0.52 

0.20 

0.87 

0.41 

51067 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

51067 

C 

0 

1 

2 

0.15 

0.00 

1.38 

-0.02 

51067 

D 

0 

5 

10 

-1.35 

0.30 

0.36 

-0.43 

51068 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

51068 

A 

1 

46 

82 

0.84 

0.16 

1.06 

0.47 

51068 

B 

0 

4 

7 

-0.86 

0.48 

0.43 

-0.35 

51068 

C 

0 

3 

5 

-0.38 

0.20 

0.56 

-0.20 

51068 

D 

0 

3 

5 

-0.43 

0.54 

0.70 

-0.21 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51069 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.03 

51069 

A 

1 

38 

73 

0.92 

0.21 

0.90 

0.48 

51069 

B 

0 

7 

13 

-0.42 

0.55 

1.24 

-0.26 

51069 

C 

0 

4 

8 

-0.83 

0.37 

0.48 

-0.28 

51069 

D 

0 

3 

6 

-0.71 

0.34 

0.49 

-0.22 

51070 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.01 

51070 

A 

1 

31 

65 

1.17 

0.27 

0.99 

0.39 

51070 

B 

0 

3 

6 

0.07 

0.16 

0.75 

-0.12 

51070 

C 

0 

8 

17 

0.20 

0.51 

2.00 

-0.17 

51070 

D 

0 

6 

13 

-0.36 

0.29 

0.59 

-0.29 

51071 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

51071 

A 

1 

25 

50 

1.44 

0.26 

0.62 

0.62 

51071 

B 

0 

8 

16 

0.44 

0.25 

1.39 

-0.02 

51071 

C 

0 

8 

16 

-1.13 

0.26 

0.29 

-0.47 

51071 

D 

0 

9 

18 

-0.62 

0.40 

0.77 

-0.34 

51072 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.02 

51072 

A 

1 

30 

56 

1.20 

0.24 

0.92 

0.49 

51072 

B 

0 

9 

17 

-0.03 

0.42 

1.06 

-0.22 

51072 

C 

0 

8 

15 

0.15 

0.25 

0.96 

-0.15 

51072 

D 

0 

7 

13 

-0.49 

0.23 

0.45 

-0.33 

51073 

* 

-1 

4719 

99 

0.90 

0.02 

0.00 

0.00 

51073 

A 

1 

19 

45 

1.81 

0.36 

1.21 

0.55 

51073 

B 

0 

6 

14 

-0.34 

0.34 

0.40 

-0.34 

51073 

C 

0 

5 

12 

0.80 

0.40 

1.39 

-0.03 

51073 

D 

0 

12 

29 

0.14 

0.29 

0.83 

-0.32 

51074 

* 

-1 

4711 

99 

0.90 

0.02 

0.00 

0.01 

51074 

A 

1 

33 

66 

1.30 

0.28 

1.32 

0.51 

51074 

B 

0 

4 

8 

-0.69 

0.40 

0.44 

-0.27 

51074 

C 

0 

6 

12 

-0.26 

0.22 

0.64 

-0.24 

51074 

D 

0 

7 

14 

-0.28 

0.32 

0.73 

-0.26 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51075 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.04 

51075 

A 

1 

30 

61 

0.74 

0.25 

1.01 

0.37 

51075 

B 

0 

7 

14 

-0.54 

0.19 

0.59 

-0.29 

51075 

C 

0 

11 

22 

0.05 

0.31 

1.55 

-0.13 

51075 

D 

0 

1 

2 

-1.29 

0.00 

0.24 

-0.19 

51076 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

-0.01 

51076 

A 

1 

29 

55 

1.42 

0.21 

0.95 

0.39 

51076 

B 

0 

6 

11 

0.45 

0.20 

0.71 

-0.18 

51076 

C 

0 

8 

15 

0.41 

0.37 

1.02 

-0.22 

51076 

D 

0 

10 

19 

0.64 

0.38 

1.31 

-0.16 

51077 

* 

-1 

4708 

99 

0.90 

0.02 

0.00 

0.02 

51077 

A 

1 

33 

62 

1.25 

0.20 

0.72 

0.53 

51077 

B 

0 

7 

13 

0.18 

0.50 

1.75 

-0.15 

51077 

C 

0 

8 

15 

-0.12 

0.43 

1.14 

-0.25 

51077 

D 

0 

5 

9 

-0.97 

0.45 

0.36 

-0.40 

51078 

* 

-1 

4707 

99 

0.91 

0.02 

0.00 

0.03 

51078 

A 

1 

16 

30 

1.06 

0.33 

1.36 

0.28 

51078 

B 

0 

17 

31 

0.71 

0.18 

1.35 

0.11 

51078 

C 

0 

17 

31 

-0.29 

0.32 

0.85 

-0.41 

51078 

D 

0 

4 

7 

0.73 

0.97 

4.00 

0.05 

51079 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.02 

51079 

A 

1 

29 

57 

1.25 

0.24 

1.19 

0.48 

51079 

B 

0 

13 

25 

-0.18 

0.25 

0.64 

-0.38 

51079 

C 

0 

4 

8 

0.95 

0.78 

3.12 

0.06 

51079 

D 

0 

5 

10 

-0.45 

0.30 

0.43 

-0.28 

51080 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.05 

51080 

A 

1 

25 

47 

1.05 

0.26 

0.86 

0.49 

51080 

B 

0 

5 

9 

0.06 

0.56 

1.14 

-0.05 

51080 

C 

0 

10 

19 

-0.13 

0.17 

0.74 

-0.15 

51080 

D 

0 

13 

25 

-0.69 

0.44 

0.91 

-0.40 



easyCBM CCSS Fifth Grade Math Measure Development 


402 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51081 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.03 

51081 

A 

1 

26 

55 

1.07 

0.30 

0.99 

0.42 

51081 

B 

0 

1 

2 

-2.62 

0.00 

0.06 

-0.31 

51081 

C 

0 

10 

21 

0.13 

0.27 

1.17 

-0.13 

51081 

D 

0 

10 

21 

-0.26 

0.36 

0.99 

-0.27 

51082 

* 

-1 

4693 

99 

0.90 

0.02 

0.00 

0.02 

51082 

A 

1 

43 

63 

1.18 

0.19 

1.15 

0.43 

51082 

B 

0 

5 

7 

0.75 

0.37 

1.66 

0.00 

51082 

C 

0 

7 

10 

0.39 

0.37 

1.27 

-0.08 

51082 

D 

0 

13 

19 

-0.57 

0.33 

0.70 

-0.47 

51083 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.05 

51083 

A 

1 

33 

66 

0.80 

0.16 

0.74 

0.64 

51083 

B 

0 

2 

4 

-0.17 

0.05 

0.73 

-0.09 

51083 

C 

0 

6 

12 

-0.57 

0.35 

0.64 

-0.30 

51083 

D 

0 

9 

18 

-0.79 

0.24 

0.49 

-0.48 

51084 

* 

-1 

4698 

99 

0.90 

0.02 

0.00 

0.00 

51084 

A 

1 

38 

60 

1.38 

0.19 

0.84 

0.49 

51084 

B 

0 

9 

14 

0.13 

0.34 

0.90 

-0.24 

51084 

C 

0 

10 

16 

0.08 

0.40 

0.98 

-0.28 

51084 

D 

0 

6 

10 

0.13 

0.31 

0.74 

-0.19 

51085 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.01 

51085 

A 

1 

35 

60 

1.23 

0.18 

1.22 

0.53 

51085 

B 

0 

6 

10 

0.46 

0.19 

0.91 

-0.08 

51085 

C 

0 

8 

14 

-0.01 

0.33 

0.79 

-0.27 

51085 

D 

0 

9 

16 

-0.27 

0.23 

0.49 

-0.39 

51086 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

51086 

A 

1 

22 

46 

1.18 

0.29 

0.88 

0.49 

51086 

B 

0 

6 

13 

-0.26 

0.41 

0.72 

-0.20 

51086 

C 

0 

9 

19 

0.47 

0.37 

2.02 

0.00 

51086 

D 

0 

11 

23 

-0.56 

0.27 

0.54 

-0.42 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51087 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

51087 

A 

1 

28 

58 

0.83 

0.27 

0.99 

0.39 

51087 

B 

0 

4 

8 

-0.17 

0.51 

1.06 

-0.13 

51087 

C 

0 

11 

23 

-0.04 

0.19 

1.00 

-0.18 

51087 

D 

0 

5 

10 

-0.57 

0.58 

0.88 

-0.26 

51088 

* 

-1 

4707 

99 

0.90 

0.02 

0.00 

0.00 

51088 

A 

1 

30 

56 

1.46 

0.23 

0.90 

0.48 

51088 

B 

0 

6 

11 

0.68 

0.24 

1.05 

-0.07 

51088 

C 

0 

9 

17 

0.41 

0.26 

0.91 

-0.18 

51088 

D 

0 

9 

17 

-0.18 

0.34 

0.56 

-0.40 

51089 

* 

-1 

4701 

99 

0.91 

0.02 

0.00 

0.02 

51089 

A 

1 

37 

62 

1.20 

0.17 

0.84 

0.58 

51089 

B 

0 

9 

15 

-0.21 

0.36 

0.70 

-0.31 

51089 

C 

0 

4 

7 

-0.41 

0.52 

0.53 

-0.24 

51089 

D 

0 

10 

17 

-0.11 

0.20 

0.64 

-0.29 

51090 

* 

-1 

4715 

99 

0.91 

0.02 

0.00 

0.03 

51090 

A 

1 

22 

48 

1.25 

0.32 

0.83 

0.52 

51090 

B 

0 

6 

13 

-0.25 

0.30 

0.64 

-0.23 

51090 

C 

0 

7 

15 

-0.19 

0.33 

0.79 

-0.23 

51090 

D 

0 

11 

24 

0.00 

0.23 

0.92 

-0.23 

51091 

* 

-1 

4709 

99 

0.90 

0.02 

0.00 

0.00 

51091 

A 

1 

37 

71 

1.47 

0.22 

0.74 

0.56 

51091 

B 

0 

3 

6 

0.26 

0.29 

0.84 

-0.11 

51091 

C 

0 

9 

17 

-0.42 

0.39 

0.67 

-0.42 

51091 

D 

0 

3 

6 

-0.78 

0.21 

0.28 

-0.29 

51092 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.01 

51092 

A 

1 

27 

47 

1.33 

0.26 

1.23 

0.40 

51092 

B 

0 

1 

2 

0.07 

0.00 

0.47 

-0.09 

51092 

C 

0 

26 

46 

0.46 

0.16 

0.97 

-0.30 

51092 

D 

0 

3 

5 

-0.07 

0.52 

0.52 

-0.18 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51093 

* 

-1 

4700 

99 

0.90 

0.02 

0.00 

0.02 

51093 

A 

1 

46 

75 

1.04 

0.20 

1.07 

0.43 

51093 

B 

0 

7 

11 

-0.30 

0.28 

0.69 

-0.27 

51093 

C 

0 

5 

8 

-0.35 

0.32 

0.64 

-0.23 

51093 

D 

0 

3 

5 

-0.21 

0.36 

0.68 

-0.15 

51094 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.02 

51094 

A 

1 

42 

88 

0.78 

0.15 

0.85 

0.41 

51094 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

51094 

C 

0 

5 

10 

-0.78 

0.56 

0.67 

-0.43 

51094 

D 

0 

1 

2 

0.39 

0.00 

1.19 

-0.03 

51095 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.03 

51095 

A 

1 

41 

73 

0.94 

0.18 

0.93 

0.42 

51095 

B 

0 

6 

11 

0.26 

0.61 

1.97 

-0.08 

51095 

C 

0 

3 

5 

-0.23 

1.09 

1.43 

-0.14 

51095 

D 

0 

6 

11 

-1.12 

0.63 

0.48 

-0.42 

51096 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.02 

51096 

A 

1 

25 

50 

0.65 

0.32 

1.71 

0.04 

51096 

B 

0 

22 

44 

0.71 

0.26 

3.39 

0.07 

51096 

C 

0 

2 

4 

-0.50 

0.73 

0.50 

-0.16 

51096 

D 

0 

1 

2 

-0.78 

0.00 

0.30 

-0.14 

51097 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

51097 

A 

1 

42 

86 

1.01 

0.23 

0.97 

0.34 

51097 

B 

0 

1 

2 

0.89 

0.00 

1.97 

0.01 

51097 

C 

0 

5 

10 

-0.53 

0.22 

0.53 

-0.31 

51097 

D 

0 

1 

2 

-0.98 

0.00 

0.31 

-0.18 

51098 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.02 

51098 

A 

1 

44 

86 

0.85 

0.22 

1.10 

0.36 

51098 

B 

0 

4 

8 

-0.25 

0.40 

1.04 

-0.17 

51098 

C 

0 

1 

2 

-0.60 

0.00 

0.58 

-0.12 

51098 

D 

0 

2 

4 

-1.70 

1.13 

0.33 

-0.31 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51099 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

51099 

A 

1 

38 

78 

1.02 

0.18 

0.82 

0.53 

51099 

B 

0 

2 

4 

-0.44 

1.77 

1.49 

-0.17 

51099 

C 

0 

5 

10 

-0.40 

0.61 

0.92 

-0.27 

51099 

D 

0 

4 

8 

-1.05 

0.45 

0.35 

-0.38 

51100 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.03 

51100 

A 

1 

39 

83 

0.73 

0.19 

0.83 

0.49 

51100 

B 

0 

4 

9 

-0.73 

0.30 

0.54 

-0.29 

51100 

C 

0 

3 

6 

-0.85 

0.75 

0.66 

-0.27 

51100 

D 

0 

1 

2 

-1.61 

0.00 

0.19 

-0.24 

51151 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

51151 

A 

1 

46 

96 

0.50 

0.17 

0.92 

0.33 

51151 

B 

0 

1 

2 

-0.82 

0.00 

0.50 

-0.15 

51151 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

51151 

D 

0 

1 

2 

-2.05 

0.00 

0.15 

-0.30 

51152 

* 

-1 

4697 

99 

0.90 

0.02 

0.00 

0.01 

51152 

A 

1 

54 

84 

0.94 

0.17 

0.99 

0.26 

51152 

B 

0 

7 

11 

0.24 

0.71 

6.52 

-0.15 

51152 

C 

0 

1 

2 

-0.83 

0.00 

0.33 

-0.16 

51152 

D 

0 

2 

3 

-0.41 

0.42 

0.54 

-0.16 

51153 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

51153 

A 

1 

48 

96 

0.44 

0.16 

1.02 

0.12 

51153 

B 

0 

1 

2 

0.09 

0.00 

1.08 

-0.04 

51153 

C 

0 

1 

2 

-0.50 

0.00 

0.60 

-0.12 

51153 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

51154 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

51154 

A 

1 

41 

85 

0.70 

0.19 

1.07 

0.32 

51154 

B 

0 

1 

2 

1.26 

0.00 

3.18 

0.08 

51154 

C 

0 

5 

10 

-0.55 

0.45 

0.77 

-0.30 

51154 

D 

0 

1 

2 

-1.48 

0.00 

0.21 

-0.24 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51155 

* 

-1 

4710 

99 

0.91 

0.02 

0.00 

0.03 

51155 

A 

1 

37 

73 

0.97 

0.21 

0.88 

0.53 

51155 

B 

0 

9 

18 

-0.33 

0.17 

0.70 

-0.29 

51155 

C 

0 

3 

6 

-1.24 

0.66 

0.39 

-0.32 

51155 

D 

0 

2 

4 

-1.22 

0.39 

0.27 

-0.26 

51156 

* 

-1 

4710 

99 

0.90 

0.02 

0.00 

0.02 

51156 

A 

1 

30 

59 

1.15 

0.22 

1.00 

0.47 

51156 

B 

0 

5 

10 

0.27 

0.70 

1.86 

-0.10 

51156 

C 

0 

15 

29 

-0.20 

0.22 

0.66 

-0.43 

51156 

D 

0 

1 

2 

0.52 

0.00 

1.01 

-0.01 

51157 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

51157 

A 

1 

31 

62 

0.58 

0.21 

1.41 

0.17 

51157 

B 

0 

4 

8 

-0.70 

0.42 

0.48 

-0.30 

51157 

C 

0 

11 

22 

0.70 

0.27 

2.13 

0.13 

51157 

D 

0 

4 

8 

-0.30 

0.46 

0.78 

-0.20 

51158 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

51158 

A 

1 

20 

41 

1.53 

0.35 

1.00 

0.50 

51158 

B 

0 

16 

33 

0.07 

0.21 

0.74 

-0.19 

51158 

C 

0 

7 

14 

-0.14 

0.24 

0.55 

-0.16 

51158 

D 

0 

6 

12 

-0.92 

1.14 

0.81 

-0.32 

51159 

* 

-1 

4506 

95 

0.87 

0.02 

0.00 

-0.09 

51159 

A 

1 

176 

69 

1.80 

0.07 

0.80 

0.58 

51159 

B 

0 

28 

11 

0.48 

0.16 

0.68 

-0.30 

51159 

C 

0 

42 

16 

0.55 

0.09 

0.61 

-0.36 

51159 

D 

0 

9 

4 

0.14 

0.17 

0.39 

-0.23 

51160 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

51160 

A 

1 

43 

86 

0.63 

0.19 

1.16 

0.12 

51160 

B 

0 

2 

4 

-0.35 

0.24 

0.65 

-0.16 

51160 

C 

0 

5 

10 

0.42 

0.52 

2.09 

-0.04 

51160 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51161 

* 

-1 

4701 

99 

0.90 

0.02 

0.00 

-0.01 

51161 

A 

1 

37 

62 

1.43 

0.25 

1.65 

0.32 

51161 

B 

0 

3 

5 

-1.25 

0.44 

0.15 

-0.36 

51161 

C 

0 

14 

23 

0.53 

0.34 

1.60 

-0.20 

51161 

D 

0 

6 

10 

1.13 

0.21 

1.57 

0.02 

51162 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

51162 

A 

1 

22 

45 

1.19 

0.37 

1.38 

0.39 

51162 

B 

0 

7 

14 

0.67 

0.32 

1.49 

0.03 

51162 

C 

0 

6 

12 

-0.49 

0.36 

0.57 

-0.26 

51162 

D 

0 

14 

29 

-0.07 

0.31 

1.10 

-0.26 

51163 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.02 

51163 

A 

1 

21 

38 

1.64 

0.32 

0.92 

0.49 

51163 

B 

0 

15 

27 

-0.12 

0.32 

0.65 

-0.28 

51163 

C 

0 

10 

18 

-0.06 

0.48 

1.12 

-0.20 

51163 

D 

0 

9 

16 

0.24 

0.59 

1.48 

-0.10 

51164 

* 

-1 

4694 

99 

0.90 

0.02 

0.00 

-0.01 

51164 

A 

1 

28 

42 

2.01 

0.21 

0.63 

0.66 

51164 

B 

0 

2 

3 

0.28 

0.08 

0.46 

-0.11 

51164 

C 

0 

9 

13 

0.49 

0.27 

0.76 

-0.18 

51164 

D 

0 

28 

42 

0.31 

0.16 

0.67 

-0.50 

51165 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.01 

51165 

A 

1 

20 

42 

1.42 

0.32 

1.10 

0.48 

51165 

B 

0 

13 

27 

0.24 

0.26 

0.90 

-0.23 

51165 

C 

0 

10 

21 

0.25 

0.19 

0.73 

-0.19 

51165 

D 

0 

5 

10 

0.09 

0.44 

0.82 

-0.17 

51166 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

51166 

A 

1 

21 

43 

1.84 

0.31 

0.69 

0.64 

51166 

B 

0 

14 

29 

-0.12 

0.24 

0.62 

-0.40 

51166 

C 

0 

8 

16 

0.50 

0.22 

0.99 

-0.09 

51166 

D 

0 

6 

12 

-0.41 

0.35 

0.44 

-0.31 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51167 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.01 

51167 

A 

1 

24 

50 

1.50 

0.30 

1.10 

0.49 

51167 

B 

0 

5 

10 

0.44 

0.41 

1.15 

-0.08 

51167 

C 

0 

8 

17 

0.11 

0.39 

0.93 

-0.21 

51167 

D 

0 

11 

23 

-0.12 

0.34 

0.72 

-0.34 

51168 

* 

-1 

4479 

94 

0.86 

0.02 

0.00 

-0.14 

51168 

A 

1 

225 

80 

1.89 

0.06 

0.88 

0.51 

51168 

B 

0 

32 

11 

0.83 

0.13 

0.77 

-0.27 

51168 

C 

0 

13 

5 

0.49 

0.22 

0.56 

-0.24 

51168 

D 

0 

12 

4 

-0.03 

0.20 

0.31 

-0.34 

51169 

* 

-1 

4481 

94 

0.86 

0.02 

0.00 

-0.12 

51169 

A 

1 

218 

78 

1.88 

0.06 

0.84 

0.56 

51169 

B 

0 

22 

8 

0.92 

0.13 

0.82 

-0.17 

51169 

C 

0 

32 

11 

0.40 

0.14 

0.54 

-0.39 

51169 

D 

0 

8 

3 

-0.81 

0.15 

0.13 

-0.38 

51170 

* 

-1 

4706 

99 

0.90 

0.02 

0.00 

0.02 

51170 

A 

1 

35 

64 

1.35 

0.23 

0.87 

0.60 

51170 

B 

0 

4 

7 

-0.60 

0.55 

0.52 

-0.24 

51170 

C 

0 

6 

11 

-0.19 

0.45 

0.81 

-0.21 

51170 

D 

0 

10 

18 

-0.60 

0.23 

0.45 

-0.41 

51171 

* 

-1 

4487 

94 

0.88 

0.02 

0.00 

-0.06 

51171 

A 

1 

201 

73 

1.50 

0.08 

0.99 

0.37 

51171 

B 

0 

35 

13 

0.76 

0.10 

1.00 

-0.15 

51171 

C 

0 

30 

11 

0.54 

0.14 

0.92 

-0.20 

51171 

D 

0 

8 

3 

-0.87 

0.42 

0.25 

-0.30 

51172 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

51172 

A 

1 

28 

56 

1.18 

0.22 

0.92 

0.57 

51172 

B 

0 

5 

10 

-0.53 

0.31 

0.45 

-0.31 

51172 

C 

0 

8 

16 

0.12 

0.29 

0.91 

-0.16 

51172 

D 

0 

9 

18 

-0.30 

0.23 

0.56 

-0.34 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51173 

* 

-1 

4708 

99 

0.91 

0.02 

0.00 

0.02 

51173 

A 

1 

48 

91 

0.76 

0.20 

0.91 

0.31 

51173 

B 

0 

2 

4 

-1.30 

0.83 

0.41 

-0.26 

51173 

C 

0 

2 

4 

0.57 

0.52 

2.20 

-0.01 

51173 

D 

0 

1 

2 

-2.50 

0.00 

0.09 

-0.30 

51174 

* 

-1 

4705 

99 

0.90 

0.02 

0.00 

0.01 

51174 

A 

1 

21 

38 

1.94 

0.31 

0.71 

0.60 

51174 

B 

0 

26 

46 

0.09 

0.22 

0.91 

-0.38 

51174 

C 

0 

3 

5 

0.34 

1.02 

1.77 

-0.06 

51174 

D 

0 

6 

11 

-0.54 

0.48 

0.40 

-0.28 

51175 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.04 

51175 

A 

1 

36 

72 

0.67 

0.18 

0.95 

0.44 

51175 

B 

0 

10 

20 

-0.27 

0.17 

0.74 

-0.31 

51175 

C 

0 

2 

4 

-0.46 

1.03 

0.85 

-0.17 

51175 

D 

0 

2 

4 

-0.61 

0.49 

0.52 

-0.20 

51176 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.03 

51176 

A 

1 

7 

15 

2.16 

0.94 

2.48 

0.49 

51176 

B 

0 

11 

23 

0.61 

0.30 

1.10 

0.02 

51176 

C 

0 

15 

32 

0.00 

0.12 

0.44 

-0.27 

51176 

D 

0 

14 

30 

0.29 

0.29 

0.90 

-0.12 

51177 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.01 

51177 

A 

1 

9 

18 

0.43 

0.39 

3.70 

-0.10 

51177 

B 

0 

5 

10 

1.18 

0.68 

1.79 

0.10 

51177 

C 

0 

27 

55 

0.89 

0.24 

1.58 

0.12 

51177 

D 

0 

8 

16 

0.29 

0.84 

1.24 

-0.13 

51178 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.01 

51178 

A 

1 

23 

48 

1.76 

0.31 

0.70 

0.61 

51178 

B 

0 

7 

15 

-0.34 

0.29 

0.45 

-0.33 

51178 

C 

0 

6 

13 

0.22 

0.43 

0.91 

-0.15 

51178 

D 

0 

12 

25 

0.01 

0.24 

0.74 

-0.32 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51179 

* 

-1 

4714 

99 

0.90 

0.02 

0.00 

0.01 

51179 

A 

1 

25 

53 

1.14 

0.25 

1.09 

0.38 

51179 

B 

0 

11 

23 

0.15 

0.29 

0.83 

-0.26 

51179 

C 

0 

6 

13 

0.06 

0.22 

0.64 

-0.21 

51179 

D 

0 

5 

11 

0.59 

0.56 

1.64 

-0.03 

51180 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.03 

51180 

A 

1 

28 

57 

0.85 

0.23 

1.24 

0.32 

51180 

B 

0 

2 

4 

-0.08 

1.01 

0.95 

-0.11 

51180 

C 

0 

5 

10 

0.43 

0.26 

1.15 

-0.03 

51180 

D 

0 

14 

29 

0.03 

0.25 

0.98 

-0.29 

51181 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.03 

51181 

A 

1 

20 

42 

0.80 

0.27 

1.37 

0.16 

51181 

B 

0 

5 

10 

1.23 

0.80 

9.91 

0.18 

51181 

C 

0 

11 

23 

0.63 

0.37 

2.73 

0.03 

51181 

D 

0 

12 

25 

-0.15 

0.28 

0.72 

-0.33 

51182 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

51182 

A 

1 

22 

45 

1.45 

0.25 

0.88 

0.57 

51182 

B 

0 

4 

8 

-0.49 

0.64 

0.56 

-0.26 

51182 

C 

0 

6 

12 

0.15 

0.36 

0.84 

-0.14 

51182 

D 

0 

17 

35 

0.04 

0.24 

0.77 

-0.35 

51183 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.01 

51183 

A 

1 

18 

38 

0.78 

0.28 

1.75 

0.01 

51183 

B 

0 

9 

19 

1.08 

0.28 

1.73 

0.15 

51183 

C 

0 

12 

25 

1.12 

0.28 

2.18 

0.20 

51183 

D 

0 

9 

19 

-0.05 

0.18 

0.48 

-0.38 

51184 

* 

-1 

4712 

99 

0.90 

0.02 

0.00 

0.02 

51184 

A 

1 

18 

37 

1.25 

0.34 

1.12 

0.39 

51184 

B 

0 

11 

22 

0.19 

0.29 

0.97 

-0.20 

51184 

C 

0 

12 

24 

0.41 

0.25 

1.12 

-0.11 

51184 

D 

0 

8 

16 

0.23 

0.33 

0.87 

-0.15 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51185 

* 

-1 

4711 

99 

0.91 

0.02 

0.00 

0.03 

51185 

A 

1 

13 

26 

1.53 

0.30 

0.66 

0.50 

51185 

B 

0 

18 

36 

0.16 

0.24 

1.01 

-0.27 

51185 

C 

0 

18 

36 

0.34 

0.23 

1.07 

-0.16 

51185 

D 

0 

1 

2 

-0.15 

0.00 

0.42 

-0.09 

51186 

* 

-1 

4704 

99 

0.90 

0.02 

0.00 

0.01 

51186 

A 

1 

43 

75 

1.01 

0.22 

1.11 

0.28 

51186 

B 

0 

2 

4 

0.23 

1.45 

2.10 

-0.07 

51186 

C 

0 

6 

11 

-0.06 

0.44 

1.33 

-0.19 

51186 

D 

0 

6 

11 

0.09 

0.74 

1.91 

-0.16 

51187 

* 

-1 

4701 

99 

0.90 

0.02 

0.00 

0.00 

51187 

A 

1 

20 

33 

1.42 

0.35 

1.99 

0.24 

51187 

B 

0 

14 

23 

0.96 

0.34 

1.44 

0.01 

51187 

C 

0 

20 

33 

0.59 

0.28 

1.20 

-0.17 

51187 

D 

0 

6 

10 

0.35 

0.73 

1.17 

-0.14 

51188 

* 

-1 

4713 

99 

0.90 

0.02 

0.00 

0.02 

51188 

A 

1 

35 

73 

0.81 

0.22 

1.25 

0.23 

51188 

B 

0 

3 

6 

0.05 

0.81 

1.58 

-0.11 

51188 

C 

0 

5 

10 

0.09 

0.49 

1.57 

-0.14 

51188 

D 

0 

5 

10 

0.20 

0.66 

2.54 

-0.11 

51189 

* 

-1 

4712 

99 

0.91 

0.02 

0.00 

0.05 

51189 

A 

1 

4 

8 

1.06 

0.96 

1.67 

0.22 

51189 

B 

0 

5 

10 

-0.18 

0.40 

0.54 

-0.15 

51189 

C 

0 

14 

29 

0.64 

0.26 

1.42 

0.22 

51189 

D 

0 

26 

53 

0.05 

0.18 

0.74 

-0.23 

51190 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

51190 

A 

1 

14 

29 

1.35 

0.30 

0.87 

0.43 

51190 

B 

0 

8 

17 

0.65 

0.53 

2.11 

0.07 

51190 

C 

0 

12 

25 

-0.37 

0.30 

0.50 

-0.34 

51190 

D 

0 

14 

29 

0.08 

0.37 

0.94 

-0.16 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51191 

* 

-1 

4697 

99 

0.91 

0.02 

0.00 

0.03 

51191 

A 

1 

14 

22 

0.98 

0.47 

2.65 

0.15 

51191 

B 

0 

14 

22 

0.79 

0.28 

1.48 

0.07 

51191 

C 

0 

9 

14 

0.10 

0.47 

0.82 

-0.16 

51191 

D 

0 

27 

42 

0.49 

0.22 

1.12 

-0.08 

51192 

* 

-1 

4694 

99 

0.90 

0.02 

0.00 

0.01 

51192 

A 

1 

6 

9 

3.07 

0.71 

0.91 

0.51 

51192 

B 

0 

36 

54 

0.77 

0.18 

0.83 

0.00 

51192 

C 

0 

12 

18 

0.23 

0.42 

0.58 

-0.18 

51192 

D 

0 

13 

19 

0.17 

0.30 

0.44 

-0.20 

51193 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.04 

51193 

A 

1 

17 

30 

1.06 

0.28 

1.24 

0.37 

51193 

B 

0 

7 

13 

0.49 

0.49 

1.96 

0.02 

51193 

C 

0 

24 

43 

0.14 

0.19 

0.96 

-0.22 

51193 

D 

0 

8 

14 

-0.08 

0.37 

0.81 

-0.19 

51194 

* 

-1 

4697 

99 

0.90 

0.02 

0.00 

0.01 

51194 

A 

1 

13 

20 

1.53 

0.48 

2.12 

0.28 

51194 

B 

0 

14 

22 

0.76 

0.31 

1.22 

0.00 

51194 

C 

0 

22 

34 

0.43 

0.29 

1.22 

-0.17 

51194 

D 

0 

15 

23 

0.60 

0.29 

1.12 

-0.07 

51195 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

51195 

A 

1 

15 

31 

0.99 

0.38 

1.58 

0.32 

51195 

B 

0 

5 

10 

-0.19 

0.21 

0.50 

-0.16 

51195 

C 

0 

21 

44 

0.36 

0.26 

1.60 

-0.03 

51195 

D 

0 

7 

15 

-0.37 

0.33 

0.52 

-0.25 

51196 

* 

-1 

4706 

99 

0.91 

0.02 

0.00 

0.05 

51196 

A 

1 

17 

31 

0.73 

0.29 

1.70 

0.28 

51196 

B 

0 

31 

56 

0.09 

0.18 

1.07 

-0.23 

51196 

C 

0 

3 

5 

0.42 

0.33 

1.04 

0.03 

51196 

D 

0 

4 

7 

-0.02 

0.25 

0.66 

-0.09 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

51197 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

51197 

A 

1 

11 

21 

0.85 

0.33 

1.52 

0.27 

51197 

B 

0 

34 

65 

0.37 

0.13 

1.03 

-0.01 

51197 

C 

0 

2 

4 

0.57 

1.33 

1.96 

0.04 

51197 

D 

0 

5 

10 

-0.73 

0.32 

0.33 

-0.39 

51198 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.04 

51198 

A 

1 

18 

38 

0.41 

0.30 

2.07 

0.00 

51198 

B 

0 

18 

38 

0.71 

0.23 

1.66 

0.19 

51198 

C 

0 

5 

10 

1.09 

0.51 

2.54 

0.19 

51198 

D 

0 

7 

15 

-0.88 

0.45 

0.42 

-0.43 

51199 

* 

-1 

4714 

99 

0.91 

0.02 

0.00 

0.03 

51199 

A 

1 

26 

55 

0.75 

0.24 

1.35 

0.32 

51199 

B 

0 

6 

13 

0.06 

0.35 

0.94 

-0.14 

51199 

C 

0 

4 

9 

-0.43 

0.44 

0.60 

-0.25 

51199 

D 

0 

11 

23 

0.26 

0.19 

1.07 

-0.09 

51200 

* 

-1 

4713 

99 

0.91 

0.02 

0.00 

0.05 

51200 

A 

1 

34 

71 

0.40 

0.19 

1.06 

0.26 

51200 

B 

0 

11 

23 

-0.19 

0.23 

0.99 

-0.24 

51200 

C 

0 

1 

2 

0.37 

0.00 

1.38 

0.02 

51200 

D 

0 

2 

4 

-0.28 

0.42 

0.79 

-0.11 

5G11 

* 

-1 

4634 

97 

0.88 

0.02 

0.00 

-0.11 

5G1 1 

A 

1 

69 

54 

2.07 

0.15 

1.25 

0.28 

5G1 1 

B 

0 

24 

19 

1.28 

0.16 

1.02 

-0.22 

5G1 1 

C 

0 

34 

27 

1.56 

0.17 

1.55 

-0.12 

5G1 1 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G110 

* 

-1 

4643 

98 

0.88 

0.02 

0.00 

-0.11 

5G110 

A 

1 

115 

97 

1.89 

0.08 

1.00 

0.20 

5G110 

B 

0 

1 

1 

0.85 

0.00 

0.51 

-0.11 

5G110 

C 

0 

2 

2 

0.78 

0.07 

0.48 

-0.16 

5G110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G111 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.09 

5G111 

A 

1 

106 

95 

1.76 

0.09 

1.00 

0.22 

5G111 

B 

0 

3 

3 

0.85 

0.54 

0.78 

-0.15 

5G111 

C 

0 

3 

3 

0.83 

0.55 

0.83 

-0.16 

5G111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G112 

* 

-1 

4422 

93 

0.86 

0.02 

0.00 

-0.13 

5G112 

A 

1 

326 

96 

1.55 

0.06 

0.98 

0.21 

5G112 

B 

0 

1 

0 

0.21 

0.00 

0.41 

-0.07 

5G112 

C 

0 

12 

4 

0.41 

0.19 

0.66 

-0.20 

5G112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G113 

* 

-1 

4557 

96 

0.88 

0.02 

0.00 

-0.09 

5G113 

A 

1 

169 

83 

1.59 

0.07 

0.97 

0.29 

5G113 

B 

0 

26 

13 

0.87 

0.15 

1.00 

-0.23 

5G113 

C 

0 

9 

4 

0.75 

0.19 

0.75 

-0.16 

5G113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G114 

* 

-1 

4663 

98 

0.89 

0.02 

0.00 

-0.09 

5G114 

A 

1 

83 

85 

1.77 

0.09 

1.02 

0.15 

5G114 

B 

0 

15 

15 

1.39 

0.25 

1.44 

-0.15 

5G114 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G115 

* 

-1 

4653 

98 

0.89 

0.02 

0.00 

-0.05 

5G115 

A 

1 

82 

76 

1.59 

0.12 

0.94 

0.37 

5G115 

B 

0 

1 

1 

0.21 

0.00 

0.40 

-0.11 

5G115 

C 

0 

25 

23 

0.70 

0.16 

0.94 

-0.35 

5G115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G116 

* 

-1 

4659 

98 

0.87 

0.02 

0.00 

-0.17 

5G116 

A 

-1 

102 

100 

2.43 

0.11 

0.00 

0.00 

5G116 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G116 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G116 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G117 

* 

-1 

4633 

97 

0.88 

0.02 

0.00 

-0.08 

5G117 

A 

1 

109 

85 

1.68 

0.10 

1.02 

0.25 

5G117 

B 

0 

19 

15 

0.94 

0.14 

0.90 

-0.25 

5G117 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G118 

* 

-1 

4634 

97 

0.89 

0.02 

0.00 

-0.06 

5G118 

A 

1 

122 

96 

1.45 

0.11 

1.04 

0.18 

5G118 

B 

0 

2 

2 

0.97 

0.36 

1.15 

-0.05 

5G118 

C 

0 

3 

2 

-0.15 

0.27 

0.38 

-0.20 

5G118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G119 

* 

-1 

4548 

96 

0.90 

0.02 

0.00 

-0.02 

5G119 

A 

1 

151 

71 

1.23 

0.08 

0.99 

0.37 

5G119 

B 

0 

3 

1 

0.12 

0.28 

0.53 

-0.11 

5G119 

C 

0 

59 

28 

0.49 

0.08 

0.84 

-0.34 

5G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G120 

* 

-1 

4646 

98 

0.88 

0.02 

0.00 

-0.12 

5G120 

A 

1 

80 

70 

2.21 

0.12 

1.07 

0.41 

5G120 

B 

0 

25 

22 

1.38 

0.15 

0.92 

-0.27 

5G120 

C 

0 

10 

9 

1.00 

0.27 

0.63 

-0.27 

5G120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G121 

* 

-1 

4657 

98 

0.89 

0.02 

0.00 

-0.05 

5G121 

A 

1 

69 

66 

1.65 

0.13 

1.11 

0.34 

5G121 

B 

0 

20 

19 

0.92 

0.18 

1.09 

-0.20 

5G121 

C 

0 

15 

14 

0.72 

0.32 

0.99 

-0.24 

5G121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G122 

* 

-1 

4650 

98 

0.89 

0.02 

0.00 

-0.06 

5G122 

A 

1 

91 

82 

1.59 

0.10 

0.93 

0.36 

5G122 

B 

0 

18 

16 

0.75 

0.18 

0.82 

-0.32 

5G122 

C 

0 

2 

2 

0.39 

0.14 

0.46 

-0.15 

5G122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G123 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.09 

5G123 

A 

1 

58 

51 

2.09 

0.18 

1.48 

0.32 

5G123 

B 

0 

43 

38 

1.45 

0.12 

1.16 

-0.17 

5G123 

C 

0 

12 

11 

0.82 

0.27 

0.62 

-0.25 

5G123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G124 

* 

-1 

4633 

97 

0.89 

0.02 

0.00 

-0.04 

5G124 

A 

1 

64 

50 

1.61 

0.13 

1.05 

0.39 

5G124 

B 

0 

32 

25 

0.74 

0.12 

0.84 

-0.27 

5G124 

C 

0 

32 

25 

0.89 

0.17 

1.29 

-0.18 

5G124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G125 

* 

-1 

4664 

98 

0.91 

0.02 

0.00 

0.02 

5G125 

A 

1 

35 

36 

1.17 

0.15 

0.97 

0.41 

5G125 

B 

0 

28 

29 

0.63 

0.10 

0.95 

-0.10 

5G125 

C 

0 

34 

35 

0.41 

0.10 

0.81 

-0.32 

5G125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G13 

* 

-1 

4553 

96 

0.86 

0.02 

0.00 

-0.16 

5G13 

A 

1 

162 

78 

2.19 

0.09 

0.93 

0.46 

5G13 

B 

0 

33 

16 

0.95 

0.13 

0.76 

-0.34 

5G13 

C 

0 

13 

6 

0.59 

0.11 

0.42 

-0.28 

5G13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G14 

* 

-1 

4634 

97 

0.88 

0.02 

0.00 

-0.11 

5G14 

A 

1 

74 

58 

2.29 

0.13 

0.87 

0.53 

5G14 

B 

0 

38 

30 

1.19 

0.13 

0.90 

-0.34 

5G14 

C 

0 

15 

12 

0.81 

0.13 

0.48 

-0.32 

5G14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G15 

* 

-1 

4643 

98 

0.88 

0.02 

0.00 

-0.11 

5G15 

A 

1 

76 

64 

2.08 

0.10 

1.02 

0.33 

5G15 

B 

0 

27 

23 

1.51 

0.14 

1.00 

-0.22 

5G15 

C 

0 

15 

13 

1.42 

0.20 

0.91 

-0.19 

5G15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G16 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.09 

5G16 

A 

1 

28 

25 

2.06 

0.15 

1.18 

0.21 

5G16 

B 

0 

67 

60 

1.49 

0.12 

1.04 

-0.29 

5G16 

C 

0 

17 

15 

2.02 

0.19 

1.45 

0.14 

5G16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G17 

* 

-1 

4638 

97 

0.88 

0.02 

0.00 

-0.12 

5G17 

A 

1 

83 

67 

2.02 

0.10 

1.17 

0.24 

5G17 

B 

0 

24 

20 

1.72 

0.14 

1.18 

-0.08 

5G17 

C 

0 

16 

13 

1.34 

0.14 

0.75 

-0.23 

5G17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G18 

* 

-1 

4663 

98 

0.89 

0.02 

0.00 

-0.09 

5G18 

A 

1 

97 

99 

1.72 

0.09 

1.00 

0.12 

5G18 

B 

0 

1 

1 

0.68 

0.00 

0.50 

-0.12 

5G18 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G19 

* 

-1 

4653 

98 

0.89 

0.02 

0.00 

-0.05 

5G19 

A 

1 

106 

98 

1.36 

0.10 

1.01 

-0.07 

5G19 

B 

0 

2 

2 

1.91 

1.81 

8.16 

0.07 

5G19 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G21 

* 

-1 

4660 

98 

0.87 

0.02 

0.00 

-0.17 

5G21 

A 

1 

53 

52 

2.93 

0.15 

0.97 

0.47 

5G21 

B 

0 

24 

24 

1.95 

0.19 

1.06 

-0.23 

5G21 

C 

0 

24 

24 

1.78 

0.19 

0.83 

-0.32 

5G21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G210 

* 

-1 

4633 

97 

0.88 

0.02 

0.00 

-0.08 

5G210 

A 

1 

100 

78 

1.78 

0.10 

0.90 

0.39 

5G210 

B 

0 

15 

12 

0.68 

0.20 

0.73 

-0.31 

5G210 

C 

0 

13 

10 

0.92 

0.14 

0.78 

-0.21 

5G210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G211 

* 

-1 

4635 

97 

0.89 

0.02 

0.00 

-0.06 

5G211 

A 

1 

99 

79 

1.67 

0.12 

0.93 

0.38 

5G211 

B 

0 

20 

16 

0.65 

0.17 

0.83 

-0.28 

5G211 

C 

0 

7 

6 

0.27 

0.45 

0.69 

-0.23 

5G211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G212 

* 

-1 

4646 

98 

0.88 

0.02 

0.00 

-0.12 

5G212 

A 

1 

105 

91 

1.94 

0.10 

1.06 

0.05 

5G212 

B 

0 

7 

6 

1.40 

0.47 

1.39 

-0.13 

5G212 

C 

0 

3 

3 

2.55 

0.11 

2.87 

0.10 

5G212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G213 

* 

-1 

4557 

96 

0.88 

0.02 

0.00 

-0.09 

5G213 

A 

1 

195 

96 

1.48 

0.07 

1.02 

0.08 

5G213 

B 

0 

3 

1 

1.24 

0.60 

1.68 

-0.03 

5G213 

C 

0 

6 

3 

1.05 

0.20 

1.05 

-0.07 

5G213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G214 

* 

-1 

4658 

98 

0.89 

0.02 

0.00 

-0.05 

5G214 

A 

1 

98 

95 

1.49 

0.10 

0.95 

0.39 

5G214 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G214 

C 

0 

5 

5 

-0.56 

0.69 

0.44 

-0.39 

5G214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G215 

* 

-1 

4650 

98 

0.89 

0.02 

0.00 

-0.06 

5G215 

A 

1 

110 

99 

1.44 

0.09 

1.00 

0.09 

5G215 

B 

0 

1 

1 

0.53 

0.00 

0.59 

-0.09 

5G215 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G216 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.09 

5G216 

A 

1 

107 

96 

1.77 

0.12 

0.98 

0.26 

5G216 

B 

0 

2 

2 

0.47 

0.42 

0.56 

-0.14 

5G216 

C 

0 

3 

3 

0.12 

0.51 

0.46 

-0.22 

5G216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G217 

* 

-1 

4635 

97 

0.89 

0.02 

0.00 

-0.04 

5G217 

A 

1 

75 

60 

1.45 

0.12 

1.12 

0.28 

5G217 

B 

0 

39 

31 

0.93 

0.15 

1.52 

-0.18 

5G217 

C 

0 

12 

10 

0.63 

0.22 

0.85 

-0.18 

5G217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G218 

* 

-1 

4665 

98 

0.91 

0.02 

0.00 

0.02 

5G218 

A 

1 

58 

60 

1.08 

0.10 

0.86 

0.52 

5G218 

B 

0 

15 

16 

0.05 

0.10 

0.57 

-0.39 

5G218 

C 

0 

23 

24 

0.39 

0.11 

0.85 

-0.26 

5G218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G219 

* 

-1 

4636 

97 

0.88 

0.02 

0.00 

-0.11 

5G219 

A 

1 

58 

46 

2.13 

0.16 

1.18 

0.29 

5G219 

B 

0 

25 

20 

1.62 

0.20 

1.41 

-0.08 

5G219 

C 

0 

42 

34 

1.42 

0.14 

1.07 

-0.24 

5G219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G22 

* 

-1 

4644 

98 

0.88 

0.02 

0.00 

-0.12 

5G22 

A 

1 

64 

55 

2.16 

0.10 

0.97 

0.35 

5G22 

B 

0 

15 

13 

1.59 

0.22 

1.16 

-0.13 

5G22 

C 

0 

38 

32 

1.54 

0.13 

1.38 

-0.28 

5G22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G220 

* 

-1 

4650 

98 

0.88 

0.02 

0.00 

-0.09 

5G220 

A 

1 

88 

79 

1.94 

0.09 

0.87 

0.45 

5G220 

B 

0 

20 

18 

0.90 

0.22 

0.88 

-0.41 

5G220 

C 

0 

3 

3 

0.91 

0.43 

0.66 

-0.14 

5G220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G221 

* 

-1 

4639 

97 

0.88 

0.02 

0.00 

-0.12 

5G221 

A 

1 

83 

68 

2.09 

0.09 

0.99 

0.37 

5G221 

B 

0 

6 

5 

1.90 

0.42 

1.82 

0.01 

5G221 

C 

0 

33 

27 

1.30 

0.12 

0.82 

-0.39 

5G221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G222 

* 

-1 

4663 

98 

0.89 

0.02 

0.00 

-0.09 

5G222 

A 

1 

82 

84 

1.80 

0.10 

1.02 

0.22 

5G222 

B 

0 

3 

3 

1.35 

0.52 

1.10 

-0.07 

5G222 

C 

0 

13 

13 

1.26 

0.22 

1.12 

-0.20 

5G222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G223 

* 

-1 

4653 

98 

0.89 

0.02 

0.00 

-0.05 

5G223 

A 

1 

74 

69 

1.67 

0.13 

0.97 

0.42 

5G223 

B 

0 

24 

22 

0.72 

0.13 

0.76 

-0.33 

5G223 

C 

0 

10 

9 

0.74 

0.20 

0.77 

-0.19 

5G223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G224 

* 

-1 

4660 

98 

0.87 

0.02 

0.00 

-0.17 

5G224 

A 

1 

96 

95 

2.45 

0.12 

1.04 

0.08 

5G224 

B 

0 

3 

3 

2.73 

0.62 

2.99 

0.05 

5G224 

C 

0 

2 

2 

1.02 

0.34 

0.43 

-0.17 

5G224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G225 

* 

-1 

4635 

97 

0.88 

0.02 

0.00 

-0.09 

5G225 

A 

1 

91 

72 

1.78 

0.11 

0.96 

0.29 

5G225 

B 

0 

24 

19 

1.32 

0.18 

1.62 

-0.13 

5G225 

C 

0 

11 

9 

0.64 

0.24 

0.72 

-0.28 

5G225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G23 

* 

-1 

4636 

97 

0.89 

0.02 

0.00 

-0.07 

5G23 

A 

1 

85 

68 

1.78 

0.13 

0.95 

0.42 

5G23 

B 

0 

15 

12 

1.02 

0.19 

1.02 

-0.13 

5G23 

C 

0 

25 

20 

0.56 

0.15 

0.64 

-0.38 

5G23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G24 

* 

-1 

4514 

95 

0.87 

0.02 

0.00 

-0.11 

5G24 

A 

1 

87 

35 

1.93 

0.14 

1.25 

0.27 

5G24 

B 

0 

91 

37 

1.41 

0.10 

1.31 

-0.09 

5G24 

C 

0 

69 

28 

1.21 

0.09 

0.94 

-0.19 

5G24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G25 

* 

-1 

4646 

98 

0.88 

0.02 

0.00 

-0.12 

5G25 

A 

1 

98 

85 

2.05 

0.10 

1.01 

0.28 

5G25 

B 

0 

15 

13 

1.31 

0.26 

1.16 

-0.22 

5G25 

C 

0 

2 

2 

0.43 

0.26 

0.33 

-0.19 

5G25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G26 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

5G26 

A 

1 

77 

77 

1.65 

0.12 

0.98 

0.36 

5G26 

B 

0 

15 

15 

0.78 

0.14 

0.74 

-0.28 

5G26 

C 

0 

8 

8 

0.82 

0.23 

0.80 

-0.19 

5G26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G27 

* 

-1 

4537 

95 

0.86 

0.02 

0.00 

-0.15 

5G27 

A 

1 

182 

81 

1.93 

0.06 

0.97 

0.31 

5G27 

B 

0 

7 

3 

0.43 

0.32 

0.43 

-0.27 

5G27 

C 

0 

35 

16 

1.37 

0.14 

1.19 

-0.20 

5G27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G28 

* 

-1 

4650 

98 

0.89 

0.02 

0.00 

-0.06 

5G28 

A 

1 

104 

94 

1.46 

0.09 

1.03 

0.13 

5G28 

B 

0 

6 

5 

1.07 

0.21 

1.09 

-0.09 

5G28 

C 

0 

1 

1 

0.24 

0.00 

0.42 

-0.12 

5G28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G29 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.09 

5G29 

A 

1 

71 

63 

2.11 

0.14 

0.99 

0.45 

5G29 

B 

0 

30 

27 

1.01 

0.16 

0.87 

-0.35 

5G29 

C 

0 

11 

10 

0.96 

0.28 

0.81 

-0.20 

5G29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G31 

* 

-1 

4547 

96 

0.86 

0.02 

0.00 

-0.14 

5G31 

A 

1 

188 

88 

1.91 

0.06 

0.97 

0.33 

5G31 

B 

0 

13 

6 

0.92 

0.22 

0.84 

-0.25 

5G31 

C 

0 

13 

6 

1.09 

0.17 

0.78 

-0.20 

5G31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G310 

* 

-1 

4636 

97 

0.89 

0.02 

0.00 

-0.04 

5G310 

A 

1 

83 

66 

1.54 

0.11 

0.92 

0.43 

5G310 

B 

0 

28 

22 

0.67 

0.14 

0.88 

-0.29 

5G310 

C 

0 

14 

11 

0.51 

0.21 

0.77 

-0.25 

5G310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G311 

* 

-1 

4665 

98 

0.91 

0.02 

0.00 

0.02 

5G311 

A 

1 

79 

82 

0.87 

0.09 

0.98 

0.32 

5G311 

B 

0 

9 

9 

0.30 

0.12 

0.80 

-0.19 

5G311 

C 

0 

8 

8 

0.11 

0.21 

0.76 

-0.25 

5G311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G312 

* 

-1 

4636 

97 

0.88 

0.02 

0.00 

-0.11 

5G312 

A 

1 

81 

65 

2.03 

0.13 

1.07 

0.30 

5G312 

B 

0 

14 

11 

1.05 

0.16 

0.69 

-0.24 

5G312 

C 

0 

30 

24 

1.48 

0.18 

1.46 

-0.16 

5G312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G313 

* 

-1 

4644 

98 

0.88 

0.02 

0.00 

-0.12 

5G313 

A 

1 

75 

64 

2.22 

0.09 

0.87 

0.52 

5G313 

B 

0 

23 

20 

1.37 

0.14 

0.84 

-0.30 

5G313 

C 

0 

19 

16 

1.20 

0.10 

0.62 

-0.35 

5G313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G314 

* 

-1 

4546 

95 

0.87 

0.02 

0.00 

-0.11 

5G314 

A 

1 

134 

62 

1.92 

0.09 

0.96 

0.40 

5G314 

B 

0 

32 

15 

1.25 

0.16 

1.23 

-0.14 

5G314 

C 

0 

49 

23 

0.91 

0.11 

0.82 

-0.35 

5G314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G315 

* 

-1 

4536 

95 

0.85 

0.02 

0.00 

-0.18 

5G315 

A 

1 

171 

76 

2.24 

0.09 

0.92 

0.42 

5G315 

B 

0 

28 

12 

0.92 

0.13 

0.61 

-0.34 

5G315 

C 

0 

26 

12 

1.31 

0.14 

0.94 

-0.20 

5G315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G316 

* 

-1 

4651 

98 

0.88 

0.02 

0.00 

-0.09 

5G316 

A 

1 

81 

74 

2.01 

0.09 

0.87 

0.51 

5G316 

B 

0 

6 

5 

0.47 

0.28 

0.41 

-0.32 

5G316 

C 

0 

23 

21 

1.04 

0.17 

0.88 

-0.37 

5G316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G317 

* 

-1 

4639 

97 

0.88 

0.02 

0.00 

-0.12 

5G317 

A 

1 

36 

30 

1.88 

0.17 

1.74 

0.01 

5G317 

B 

0 

33 

27 

1.71 

0.17 

1.20 

-0.11 

5G317 

C 

0 

53 

43 

1.95 

0.11 

1.30 

0.08 

5G317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G318 

* 

-1 

4663 

98 

0.89 

0.02 

0.00 

-0.09 

5G318 

A 

1 

51 

52 

1.78 

0.13 

1.32 

0.08 

5G318 

B 

0 

34 

35 

1.89 

0.13 

1.61 

0.14 

5G318 

C 

0 

13 

13 

1.01 

0.15 

0.58 

-0.31 

5G318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G319 

* 

-1 

4653 

98 

0.89 

0.02 

0.00 

-0.05 

5G319 

A 

1 

57 

53 

1.57 

0.16 

1.28 

0.20 

5G319 

B 

0 

20 

19 

1.02 

0.24 

1.35 

-0.16 

5G319 

C 

0 

31 

29 

1.24 

0.13 

1.27 

-0.08 

5G319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G32 

* 

-1 

4551 

96 

0.86 

0.02 

0.00 

-0.13 

5G32 

A 

1 

106 

50 

2.11 

0.10 

1.04 

0.37 

5G32 

B 

0 

58 

28 

1.49 

0.11 

1.21 

-0.13 

5G32 

C 

0 

46 

22 

1.09 

0.13 

0.86 

-0.31 

5G32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G320 

* 

-1 

4660 

98 

0.87 

0.02 

0.00 

-0.17 

5G320 

A 

1 

84 

83 

2.53 

0.13 

1.11 

0.21 

5G320 

B 

0 

11 

11 

1.76 

0.28 

1.01 

-0.20 

5G320 

C 

0 

6 

6 

2.12 

0.27 

1.26 

-0.07 

5G320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G321 

* 

-1 

4636 

97 

0.88 

0.02 

0.00 

-0.09 

5G321 

A 

1 

88 

70 

1.78 

0.12 

1.02 

0.26 

5G321 

B 

0 

23 

18 

1.18 

0.14 

1.00 

-0.19 

5G321 

C 

0 

14 

11 

1.20 

0.24 

1.29 

-0.14 

5G321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G322 

* 

-1 

4636 

97 

0.89 

0.02 

0.00 

-0.07 

5G322 

A 

1 

84 

67 

1.81 

0.13 

0.89 

0.44 

5G322 

B 

0 

14 

11 

0.75 

0.17 

0.75 

-0.21 

5G322 

C 

0 

27 

22 

0.68 

0.18 

0.92 

-0.34 

5G322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G323 

* 

-1 

4646 

98 

0.88 

0.02 

0.00 

-0.12 

5G323 

A 

1 

83 

72 

2.20 

0.11 

1.03 

0.42 

5G323 

B 

0 

7 

6 

1.16 

0.38 

0.87 

-0.18 

5G323 

C 

0 

25 

22 

1.23 

0.16 

0.86 

-0.35 

5G323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G324 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.06 

5G324 

A 

1 

46 

46 

1.94 

0.15 

0.88 

0.44 

5G324 

B 

0 

16 

16 

0.79 

0.18 

0.71 

-0.30 

5G324 

C 

0 

37 

37 

1.17 

0.14 

1.24 

-0.23 

5G324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G325 

* 

-1 

4651 

98 

0.89 

0.02 

0.00 

-0.06 

5G325 

A 

1 

45 

41 

1.96 

0.14 

0.88 

0.46 

5G325 

B 

0 

36 

33 

0.97 

0.12 

0.83 

-0.36 

5G325 

C 

0 

29 

26 

1.24 

0.13 

1.06 

-0.13 

5G325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G33 

* 

-1 

4651 

98 

0.88 

0.02 

0.00 

-0.09 

5G33 

A 

1 

69 

63 

2.19 

0.13 

0.84 

0.52 

5G33 

B 

0 

24 

22 

1.24 

0.16 

1.05 

-0.21 

5G33 

C 

0 

17 

15 

0.44 

0.18 

0.46 

-0.45 

5G33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G34 

* 

-1 

4636 

97 

0.89 

0.02 

0.00 

-0.04 

5G34 

A 

1 

95 

76 

1.39 

0.10 

1.01 

0.28 

5G34 

B 

0 

23 

18 

0.73 

0.19 

1.19 

-0.23 

5G34 

C 

0 

7 

6 

0.69 

0.27 

0.97 

-0.13 

5G34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G35 

* 

-1 

4665 

98 

0.91 

0.02 

0.00 

0.02 

5G35 

A 

1 

38 

40 

0.96 

0.12 

1.06 

0.21 

5G35 

B 

0 

49 

51 

0.52 

0.10 

0.96 

-0.30 

5G35 

C 

0 

9 

9 

1.15 

0.37 

2.96 

0.16 

5G35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G36 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.11 

5G36 

A 

1 

69 

62 

1.98 

0.14 

1.22 

0.15 

5G36 

B 

0 

20 

18 

1.46 

0.19 

1.12 

-0.16 

5G36 

C 

0 

23 

21 

1.79 

0.23 

2.21 

-0.02 

5G36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G37 

* 

-1 

4646 

98 

0.88 

0.02 

0.00 

-0.11 

5G37 

A 

1 

67 

58 

2.18 

0.10 

0.92 

0.44 

5G37 

B 

0 

25 

22 

1.54 

0.15 

1.01 

-0.21 

5G37 

C 

0 

23 

20 

1.32 

0.12 

0.72 

-0.33 

5G37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G38 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.09 

5G38 

A 

1 

57 

55 

2.07 

0.11 

0.99 

0.40 

5G38 

B 

0 

11 

11 

0.91 

0.30 

0.71 

-0.29 

5G38 

C 

0 

36 

35 

1.42 

0.14 

1.08 

-0.23 

5G38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G39 

* 

-1 

4647 

98 

0.88 

0.02 

0.00 

-0.11 

5G39 

A 

1 

104 

91 

1.95 

0.09 

1.00 

0.24 

5G39 

B 

0 

8 

7 

1.09 

0.20 

0.70 

-0.24 

5G39 

C 

0 

2 

2 

1.56 

1.21 

1.81 

-0.05 

5G39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G41 

* 

-1 

4663 

98 

0.89 

0.02 

0.00 

-0.09 

5G41 

A 

1 

75 

77 

1.85 

0.10 

1.00 

0.27 

5G41 

B 

0 

13 

13 

1.35 

0.25 

1.18 

-0.16 

5G41 

C 

0 

10 

10 

1.19 

0.24 

0.92 

-0.20 

5G41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G410 

* 

-1 

4654 

98 

0.89 

0.02 

0.00 

-0.05 

5G410 

A 

1 

81 

76 

1.67 

0.11 

0.88 

0.48 

5G410 

B 

0 

15 

14 

0.58 

0.16 

0.69 

-0.31 

5G410 

C 

0 

11 

10 

0.39 

0.13 

0.52 

-0.32 

5G410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G411 

* 

-1 

4661 

98 

0.87 

0.02 

0.00 

-0.17 

5G411 

A 

1 

72 

72 

2.65 

0.13 

1.03 

0.30 

5G411 

B 

0 

16 

16 

2.07 

0.26 

1.37 

-0.14 

5G411 

C 

0 

12 

12 

1.63 

0.31 

0.97 

-0.26 

5G411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G412 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5G412 

A 

1 

85 

69 

1.83 

0.12 

1.02 

0.34 

5G412 

B 

0 

16 

13 

1.01 

0.13 

0.79 

-0.22 

5G412 

C 

0 

23 

19 

1.11 

0.11 

0.85 

-0.22 

5G412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G413 

* 

-1 

4639 

97 

0.89 

0.02 

0.00 

-0.07 

5G413 

A 

1 

87 

71 

1.74 

0.12 

0.98 

0.38 

5G413 

B 

0 

21 

17 

0.76 

0.16 

1.08 

-0.28 

5G413 

C 

0 

14 

11 

0.81 

0.19 

0.86 

-0.21 

5G413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G414 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.12 

5G414 

A 

1 

12 

11 

1.94 

0.36 

2.67 

0.00 

5G414 

B 

0 

14 

12 

1.44 

0.29 

0.74 

-0.17 

5G414 

C 

0 

87 

77 

2.01 

0.11 

1.24 

0.13 

5G414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G415 

* 

-1 

4665 

98 

0.89 

0.02 

0.00 

-0.06 

5G415 

A 

1 

62 

65 

1.68 

0.13 

1.02 

0.29 

5G415 

B 

0 

29 

30 

1.12 

0.17 

1.49 

-0.22 

5G415 

C 

0 

5 

5 

0.72 

0.28 

0.67 

-0.17 

5G415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G416 

* 

-1 

4655 

98 

0.89 

0.02 

0.00 

-0.06 

5G416 

A 

1 

64 

60 

1.77 

0.11 

0.98 

0.39 

5G416 

B 

0 

26 

25 

1.04 

0.18 

1.62 

-0.27 

5G416 

C 

0 

16 

15 

1.02 

0.12 

0.81 

-0.21 

5G416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G417 

* 

-1 

4513 

95 

0.87 

0.02 

0.00 

-0.11 

5G417 

A 

1 

197 

79 

1.71 

0.08 

0.95 

0.32 

5G417 

B 

0 

29 

12 

1.02 

0.18 

1.55 

-0.17 

5G417 

C 

0 

22 

9 

0.64 

0.12 

0.63 

-0.26 

5G417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G418 

* 

-1 

4656 

98 

0.88 

0.02 

0.00 

-0.10 

5G418 

A 

1 

70 

67 

2.10 

0.14 

0.98 

0.40 

5G418 

B 

0 

12 

11 

1.08 

0.32 

1.17 

-0.22 

5G418 

C 

0 

23 

22 

1.14 

0.14 

0.81 

-0.29 

5G418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G419 

* 

-1 

4548 

96 

0.90 

0.02 

0.00 

-0.02 

5G419 

A 

1 

143 

67 

1.23 

0.08 

0.99 

0.33 

5G419 

B 

0 

23 

11 

0.26 

0.17 

0.80 

-0.28 

5G419 

C 

0 

47 

22 

0.73 

0.10 

1.12 

-0.16 

5G419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G42 

* 

-1 

4644 

98 

0.89 

0.02 

0.00 

-0.04 

5G42 

A 

1 

71 

61 

1.55 

0.12 

0.97 

0.40 

5G42 

B 

0 

19 

16 

0.71 

0.20 

1.04 

-0.23 

5G42 

C 

0 

27 

23 

0.73 

0.15 

0.90 

-0.27 

5G42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G420 

* 

-1 

4665 

98 

0.91 

0.02 

0.00 

0.02 

5G420 

A 

1 

54 

56 

0.90 

0.10 

1.02 

0.21 

5G420 

B 

0 

17 

18 

0.35 

0.15 

0.83 

-0.24 

5G420 

C 

0 

25 

26 

0.71 

0.18 

1.79 

-0.03 

5G420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G421 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.11 

5G421 

A 

1 

66 

59 

2.31 

0.14 

0.89 

0.49 

5G421 

B 

0 

19 

17 

0.94 

0.11 

0.53 

-0.37 

5G421 

C 

0 

27 

24 

1.37 

0.16 

1.13 

-0.24 

5G421 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G422 

* 

-1 

4646 

98 

0.88 

0.02 

0.00 

-0.11 

5G422 

A 

1 

112 

97 

1.89 

0.08 

1.00 

0.15 

5G422 

B 

0 

2 

2 

1.06 

0.21 

0.61 

-0.13 

5G422 

C 

0 

1 

1 

1.13 

0.00 

0.64 

-0.08 

5G422 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G423 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.09 

5G423 

A 

1 

81 

79 

1.93 

0.09 

0.92 

0.39 

5G423 

B 

0 

11 

11 

0.81 

0.25 

0.65 

-0.34 

5G423 

C 

0 

11 

11 

1.27 

0.34 

1.37 

-0.17 

5G423 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G424 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5G424 

A 

1 

79 

70 

2.15 

0.10 

0.92 

0.45 

5G424 

B 

0 

15 

13 

1.32 

0.19 

0.84 

-0.24 

5G424 

C 

0 

19 

17 

1.20 

0.16 

0.74 

-0.34 

5G424 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G425 

* 

-1 

4664 

98 

0.89 

0.02 

0.00 

-0.09 

5G425 

A 

1 

47 

48 

2.17 

0.12 

0.89 

0.49 

5G425 

B 

0 

37 

38 

1.36 

0.11 

0.89 

-0.32 

5G425 

C 

0 

13 

13 

1.16 

0.22 

0.82 

-0.25 

5G425 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G43 

* 

-1 

4655 

98 

0.89 

0.02 

0.00 

-0.05 

5G43 

A 

1 

51 

48 

1.73 

0.16 

1.14 

0.32 

5G43 

B 

0 

27 

25 

1.36 

0.19 

1.62 

-0.01 

5G43 

C 

0 

28 

26 

0.77 

0.11 

0.66 

-0.35 

5G43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G44 

* 

-1 

4661 

98 

0.87 

0.02 

0.00 

-0.17 

5G44 

A 

1 

93 

93 

2.54 

0.11 

0.93 

0.34 

5G44 

B 

0 

4 

4 

0.64 

0.32 

0.32 

-0.32 

5G44 

C 

0 

3 

3 

1.55 

0.30 

0.72 

-0.14 

5G44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G45 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5G45 

A 

1 

80 

65 

1.79 

0.13 

1.10 

0.26 

5G45 

B 

0 

18 

15 

1.01 

0.12 

0.74 

-0.23 

5G45 

C 

0 

26 

21 

1.38 

0.14 

1.27 

-0.10 

5G45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G46 

* 

-1 

4639 

97 

0.89 

0.02 

0.00 

-0.07 

5G46 

A 

1 

72 

59 

1.82 

0.15 

1.09 

0.37 

5G46 

B 

0 

20 

16 

0.75 

0.14 

0.73 

-0.28 

5G46 

C 

0 

30 

25 

1.10 

0.13 

1.06 

-0.19 

5G46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G47 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.12 

5G47 

A 

1 

88 

78 

2.27 

0.10 

0.80 

0.59 

5G47 

B 

0 

15 

13 

0.73 

0.18 

0.52 

-0.44 

5G47 

C 

0 

10 

9 

0.74 

0.20 

0.47 

-0.35 

5G47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5G48 

* 

-1 

4665 

98 

0.89 

0.02 

0.00 

-0.06 

5G48 

A 

1 

64 

67 

1.80 

0.13 

0.89 

0.47 

5G48 

B 

0 

22 

23 

0.76 

0.12 

0.69 

-0.37 

5G48 

C 

0 

10 

10 

0.81 

0.19 

0.75 

-0.22 

5G48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5G49 

* 

-1 

4556 

96 

0.87 

0.02 

0.00 

-0.10 

5G49 

A 

1 

150 

73 

1.76 

0.08 

1.00 

0.36 

5G49 

B 

0 

38 

19 

1.04 

0.13 

1.11 

-0.24 

5G49 

C 

0 

17 

8 

0.78 

0.16 

0.71 

-0.23 

5G49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD11 

* 

-1 

4656 

98 

0.89 

0.02 

0.00 

-0.06 

5MD11 

A 

1 

30 

29 

1.86 

0.18 

1.07 

0.30 

5MD11 

B 

0 

23 

22 

1.13 

0.15 

0.82 

-0.19 

5MD11 

C 

0 

52 

50 

1.34 

0.11 

1.09 

-0.11 

5MD11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD110 

* 

-1 

4656 

98 

0.88 

0.02 

0.00 

-0.10 

5MD110 

A 

1 

47 

45 

2.16 

0.20 

1.47 

0.31 

5MD110 

B 

0 

48 

46 

1.44 

0.11 

1.02 

-0.26 

5MD110 

C 

0 

10 

10 

1.52 

0.26 

1.01 

-0.07 

5MD110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD111 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.04 

5MD111 

A 

1 

69 

59 

1.60 

0.12 

0.92 

0.46 

5MD111 

B 

0 

22 

19 

0.67 

0.15 

0.80 

-0.26 

5MD111 

C 

0 

25 

22 

0.63 

0.15 

0.80 

-0.30 

5MD111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD112 

* 

-1 

4665 

98 

0.91 

0.02 

0.00 

0.02 

5MD112 

A 

1 

22 

23 

0.61 

0.13 

1.57 

-0.10 

5MD112 

B 

0 

30 

31 

0.85 

0.19 

1.95 

0.09 

5MD112 

C 

0 

44 

46 

0.75 

0.09 

1.07 

0.00 

5MD112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD113 

* 

-1 

4650 

98 

0.88 

0.02 

0.00 

-0.11 

5MD113 

A 

1 

63 

57 

2.15 

0.16 

1.19 

0.31 

5MD113 

B 

0 

24 

22 

1.28 

0.13 

0.80 

-0.27 

5MD113 

C 

0 

24 

22 

1.63 

0.18 

1.38 

-0.10 

5MD113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD114 

* 

-1 

4646 

98 

0.88 

0.02 

0.00 

-0.11 

5MD114 

A 

1 

42 

37 

2.08 

0.13 

1.21 

0.19 

5MD114 

B 

0 

17 

15 

1.38 

0.17 

0.81 

-0.24 

5MD114 

C 

0 

56 

49 

1.86 

0.11 

1.27 

-0.01 

5MD114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD115 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.09 

5MD115 

A 

1 

63 

61 

2.11 

0.11 

1.06 

0.49 

5MD115 

B 

0 

16 

16 

1.06 

0.21 

0.80 

-0.31 

5MD115 

C 

0 

24 

23 

1.23 

0.12 

0.76 

-0.30 

5MD115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD116 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.11 

5MD116 

A 

1 

77 

69 

2.05 

0.10 

1.05 

0.30 

5MD116 

B 

0 

21 

19 

1.33 

0.18 

0.93 

-0.28 

5MD116 

C 

0 

14 

13 

1.64 

0.22 

1.25 

-0.09 

5MD116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD117 

* 

-1 

4664 

98 

0.89 

0.02 

0.00 

-0.09 

5MD117 

A 

1 

67 

69 

1.92 

0.11 

1.04 

0.33 

5MD117 

B 

0 

21 

22 

1.26 

0.17 

0.99 

-0.28 

5MD117 

C 

0 

9 

9 

1.37 

0.16 

0.89 

-0.13 

5MD117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD118 

* 

-1 

4549 

96 

0.87 

0.02 

0.00 

-0.11 

5MD118 

A 

1 

90 

42 

2.17 

0.12 

0.99 

0.45 

5MD118 

B 

0 

70 

33 

1.34 

0.08 

0.95 

-0.19 

5MD118 

C 

0 

52 

25 

1.03 

0.10 

0.73 

-0.32 

5MD118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD119 

* 

-1 

4656 

98 

0.89 

0.02 

0.00 

-0.05 

5MD119 

A 

1 

52 

50 

1.86 

0.16 

1.05 

0.45 

5MD119 

B 

0 

37 

35 

0.75 

0.11 

0.69 

-0.44 

5MD119 

C 

0 

16 

15 

1.30 

0.17 

1.17 

-0.03 

5MD119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD12 

* 

-1 

4661 

98 

0.87 

0.02 

0.00 

-0.17 

5MD12 

A 

1 

37 

37 

3.30 

0.18 

0.92 

0.58 

5MD12 

B 

0 

25 

25 

1.81 

0.15 

0.64 

-0.32 

5MD12 

C 

0 

38 

38 

2.01 

0.14 

0.92 

-0.29 

5MD12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD120 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5MD120 

A 

1 

55 

44 

1.72 

0.16 

1.42 

0.11 

5MD120 

B 

0 

15 

12 

1.17 

0.19 

0.90 

-0.15 

5MD120 

C 

0 

54 

44 

1.58 

0.12 

2.07 

-0.01 

5MD120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD121 

* 

-1 

4639 

97 

0.89 

0.02 

0.00 

-0.07 

5MD121 

A 

1 

58 

48 

1.90 

0.17 

1.09 

0.36 

5MD121 

B 

0 

48 

39 

1.12 

0.12 

1.10 

-0.25 

5MD121 

C 

0 

16 

13 

0.95 

0.17 

0.80 

-0.18 

5MD121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD122 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.12 

5MD122 

A 

1 

66 

59 

2.21 

0.13 

1.12 

0.30 

5MD122 

B 

0 

25 

22 

1.84 

0.20 

1.42 

-0.05 

5MD122 

C 

0 

21 

19 

1.22 

0.19 

0.81 

-0.33 

5MD122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD123 

* 

-1 

4666 

98 

0.89 

0.02 

0.00 

-0.06 

5MD123 

A 

1 

39 

41 

1.94 

0.17 

0.94 

0.40 

5MD123 

B 

0 

36 

38 

1.22 

0.14 

1.32 

-0.18 

5MD123 

C 

0 

20 

21 

0.91 

0.17 

0.80 

-0.27 

5MD123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD124 

* 

-1 

4656 

98 

0.89 

0.02 

0.00 

-0.06 

5MD124 

A 

1 

25 

24 

2.33 

0.16 

0.65 

0.56 

5MD124 

B 

0 

66 

63 

1.19 

0.09 

0.94 

-0.39 

5MD124 

C 

0 

14 

13 

1.09 

0.18 

0.72 

-0.16 

5MD124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD125 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5MD125 

A 

1 

43 

41 

2.34 

0.19 

1.13 

0.42 

5MD125 

B 

0 

37 

36 

1.36 

0.13 

0.90 

-0.26 

5MD125 

C 

0 

24 

23 

1.37 

0.20 

1.20 

-0.19 

5MD125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD126 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.04 

5MD126 

A 

1 

30 

26 

1.98 

0.22 

1.10 

0.45 

5MD126 

B 

0 

25 

22 

0.71 

0.15 

0.73 

-0.26 

5MD126 

C 

0 

61 

53 

1.05 

0.10 

0.98 

-0.18 

5MD126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD127 

* 

-1 

4665 

98 

0.91 

0.02 

0.00 

0.02 

5MD127 

A 

1 

20 

21 

0.85 

0.25 

1.59 

0.06 

5MD127 

B 

0 

55 

57 

0.78 

0.09 

1.10 

0.04 

5MD127 

C 

0 

21 

22 

0.59 

0.16 

0.95 

-0.11 

5MD127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD128 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.11 

5MD128 

A 

1 

44 

40 

2.12 

0.19 

1.40 

0.19 

5MD128 

B 

0 

27 

25 

1.65 

0.16 

1.09 

-0.11 

5MD128 

C 

0 

38 

35 

1.70 

0.18 

2.13 

-0.10 

5MD128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD129 

* 

-1 

4647 

98 

0.88 

0.02 

0.00 

-0.11 

5MD129 

A 

1 

40 

35 

2.05 

0.15 

1.29 

0.15 

5MD129 

B 

0 

52 

46 

1.78 

0.09 

1.04 

-0.11 

5MD129 

C 

0 

22 

19 

1.79 

0.20 

1.25 

-0.05 

5MD129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD13 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.09 

5MD13 

A 

1 

55 

53 

2.01 

0.14 

1.28 

0.31 

5MD13 

B 

0 

17 

17 

1.15 

0.19 

0.75 

-0.28 

5MD13 

C 

0 

31 

30 

1.59 

0.12 

1.05 

-0.11 

5MD13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD130 

* 

-1 

4651 

98 

0.88 

0.02 

0.00 

-0.11 

5MD130 

A 

1 

27 

25 

2.33 

0.20 

1.24 

0.30 

5MD130 

B 

0 

20 

18 

1.44 

0.20 

0.80 

-0.22 

5MD130 

C 

0 

63 

57 

1.78 

0.10 

1.04 

-0.10 

5MD130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD14 

* 

-1 

4664 

98 

0.89 

0.02 

0.00 

-0.09 

5MD14 

A 

1 

30 

31 

1.93 

0.17 

1.34 

0.16 

5MD14 

B 

0 

37 

38 

1.59 

0.14 

1.18 

-0.12 

5MD14 

C 

0 

30 

31 

1.68 

0.15 

1.17 

-0.03 

5MD14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD15 

* 

-1 

4656 

98 

0.89 

0.02 

0.00 

-0.05 

5MD15 

A 

1 

43 

41 

1.73 

0.18 

1.25 

0.27 

5MD15 

B 

0 

32 

30 

1.15 

0.18 

1.33 

-0.14 

5MD15 

C 

0 

30 

29 

1.14 

0.15 

1.11 

-0.15 

5MD15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD16 

* 

-1 

4548 

96 

0.88 

0.02 

0.00 

-0.07 

5MD16 

A 

1 

38 

18 

2.34 

0.25 

1.51 

0.43 

5MD16 

B 

0 

158 

74 

1.15 

0.07 

0.97 

-0.27 

5MD16 

C 

0 

17 

8 

0.72 

0.15 

0.46 

-0.16 

5MD16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD17 

* 

-1 

4661 

98 

0.87 

0.02 

0.00 

-0.17 

5MD17 

A 

1 

24 

24 

2.92 

0.27 

1.81 

0.24 

5MD17 

B 

0 

18 

18 

2.12 

0.23 

0.92 

-0.13 

5MD17 

C 

0 

58 

58 

2.34 

0.14 

1.20 

-0.10 

5MD17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD18 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5MD18 

A 

1 

34 

27 

2.05 

0.25 

1.31 

0.27 

5MD18 

B 

0 

53 

43 

1.29 

0.10 

0.90 

-0.25 

5MD18 

C 

0 

37 

30 

1.59 

0.14 

1.31 

0.00 

5MD18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD19 

* 

-1 

4639 

97 

0.89 

0.02 

0.00 

-0.07 

5MD19 

A 

1 

50 

41 

1.92 

0.20 

1.27 

0.33 

5MD19 

B 

0 

42 

34 

1.21 

0.13 

1.12 

-0.16 

5MD19 

C 

0 

30 

25 

1.08 

0.11 

0.83 

-0.20 

5MD19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD21 

* 

-1 

4651 

98 

0.88 

0.02 

0.00 

-0.12 

5MD21 

A 

1 

79 

72 

2.24 

0.11 

0.92 

0.47 

5MD21 

B 

0 

25 

23 

1.21 

0.17 

0.81 

-0.36 

5MD21 

C 

0 

6 

5 

0.80 

0.26 

0.49 

-0.26 

5MD21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD210 

* 

-1 

4666 

98 

0.89 

0.02 

0.00 

-0.06 

5MD210 

A 

1 

79 

83 

1.62 

0.12 

0.96 

0.37 

5MD210 

B 

0 

10 

11 

0.48 

0.11 

0.53 

-0.33 

5MD210 

C 

0 

6 

6 

0.82 

0.16 

0.76 

-0.16 

5MD210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD211 

* 

-1 

4656 

98 

0.89 

0.02 

0.00 

-0.06 

5MD211 

A 

1 

69 

66 

1.64 

0.11 

1.02 

0.31 

5MD211 

B 

0 

28 

27 

1.10 

0.12 

0.99 

-0.24 

5MD211 

C 

0 

8 

8 

0.97 

0.28 

0.89 

-0.16 

5MD211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD212 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5MD212 

A 

1 

60 

58 

2.09 

0.15 

1.06 

0.32 

5MD212 

B 

0 

33 

32 

1.43 

0.19 

2.00 

-0.20 

5MD212 

C 

0 

11 

11 

1.04 

0.26 

0.77 

-0.22 

5MD212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD213 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.04 

5MD213 

A 

1 

79 

68 

1.43 

0.11 

1.01 

0.32 

5MD213 

B 

0 

19 

16 

1.04 

0.17 

1.30 

-0.08 

5MD213 

C 

0 

18 

16 

0.43 

0.20 

0.79 

-0.33 

5MD213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD214 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5MD214 

A 

1 

33 

35 

1.05 

0.18 

1.20 

0.27 

5MD214 

B 

0 

45 

47 

0.62 

0.08 

0.94 

-0.17 

5MD214 

C 

0 

17 

18 

0.55 

0.16 

0.93 

-0.12 

5MD214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD215 

* 

-1 

4654 

98 

0.88 

0.02 

0.00 

-0.11 

5MD215 

A 

1 

53 

50 

2.31 

0.17 

1.08 

0.38 

5MD215 

B 

0 

20 

19 

1.27 

0.18 

0.86 

-0.26 

5MD215 

C 

0 

34 

32 

1.56 

0.15 

1.28 

-0.19 

5MD215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD216 

* 

-1 

4647 

98 

0.88 

0.02 

0.00 

-0.11 

5MD216 

A 

1 

59 

52 

2.29 

0.10 

0.85 

0.51 

5MD216 

B 

0 

23 

20 

1.22 

0.12 

0.62 

-0.40 

5MD216 

C 

0 

32 

28 

1.59 

0.11 

0.94 

-0.22 

5MD216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD217 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.09 

5MD217 

A 

1 

63 

62 

2.00 

0.11 

1.00 

0.36 

5MD217 

B 

0 

25 

25 

1.40 

0.15 

0.99 

-0.21 

5MD217 

C 

0 

14 

14 

1.16 

0.33 

1.23 

-0.24 

5MD217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD218 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.11 

5MD218 

A 

1 

64 

59 

2.22 

0.11 

0.90 

0.49 

5MD218 

B 

0 

23 

21 

1.36 

0.17 

0.88 

-0.28 

5MD218 

C 

0 

22 

20 

1.29 

0.13 

0.73 

-0.31 

5MD218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD219 

* 

-1 

4665 

98 

0.89 

0.02 

0.00 

-0.09 

5MD219 

A 

1 

48 

50 

2.09 

0.13 

1.03 

0.42 

5MD219 

B 

0 

18 

19 

1.00 

0.13 

0.57 

-0.39 

5MD219 

C 

0 

30 

31 

1.57 

0.12 

1.11 

-0.12 

5MD219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD22 

* 

-1 

4657 

98 

0.89 

0.02 

0.00 

-0.05 

5MD22 

A 

1 

45 

43 

1.88 

0.17 

1.05 

0.40 

5MD22 

B 

0 

32 

31 

1.05 

0.13 

0.94 

-0.21 

5MD22 

C 

0 

27 

26 

0.98 

0.17 

1.00 

-0.23 

5MD22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD220 

* 

-1 

4661 

98 

0.87 

0.02 

0.00 

-0.17 

5MD220 

A 

1 

58 

58 

2.84 

0.15 

1.10 

0.41 

5MD220 

B 

0 

28 

28 

2.03 

0.16 

1.02 

-0.22 

5MD220 

C 

0 

14 

14 

1.58 

0.20 

0.59 

-0.30 

5MD220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD221 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5MD221 

A 

1 

66 

53 

2.03 

0.14 

0.92 

0.45 

5MD221 

B 

0 

41 

33 

1.09 

0.11 

0.87 

-0.34 

5MD221 

C 

0 

17 

14 

1.11 

0.09 

0.73 

-0.18 

5MD221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD222 

* 

-1 

4640 

97 

0.89 

0.02 

0.00 

-0.07 

5MD222 

A 

1 

64 

53 

1.96 

0.15 

0.94 

0.48 

5MD222 

B 

0 

31 

26 

0.88 

0.11 

0.78 

-0.30 

5MD222 

C 

0 

26 

21 

0.87 

0.14 

0.82 

-0.27 

5MD222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD223 

* 

-1 

4651 

98 

0.88 

0.02 

0.00 

-0.12 

5MD223 

A 

1 

44 

40 

1.96 

0.14 

1.59 

0.02 

5MD223 

B 

0 

37 

34 

2.20 

0.20 

2.34 

0.18 

5MD223 

C 

0 

29 

26 

1.53 

0.17 

0.90 

-0.22 

5MD223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD224 

* 

-1 

4666 

98 

0.89 

0.02 

0.00 

-0.06 

5MD224 

A 

1 

29 

31 

1.91 

0.24 

1.23 

0.30 

5MD224 

B 

0 

35 

37 

1.25 

0.10 

0.88 

-0.15 

5MD224 

C 

0 

31 

33 

1.24 

0.18 

1.28 

-0.14 

5MD224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD225 

* 

-1 

4656 

98 

0.89 

0.02 

0.00 

-0.06 

5MD225 

A 

1 

38 

36 

1.61 

0.17 

1.38 

0.14 

5MD225 

B 

0 

46 

44 

1.41 

0.12 

1.24 

-0.03 

5MD225 

C 

0 

21 

20 

1.23 

0.15 

0.99 

-0.12 

5MD225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD226 

* 

-1 

4547 

96 

0.86 

0.02 

0.00 

-0.14 

5MD226 

A 

1 

72 

34 

2.24 

0.11 

1.05 

0.35 

5MD226 

B 

0 

60 

28 

1.77 

0.11 

1.24 

-0.02 

5MD226 

C 

0 

82 

38 

1.43 

0.08 

0.83 

-0.32 

5MD226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD227 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5MD227 

A 

1 

55 

53 

2.26 

0.16 

0.97 

0.46 

5MD227 

B 

0 

30 

29 

1.33 

0.16 

1.08 

-0.25 

5MD227 

C 

0 

19 

18 

1.03 

0.18 

0.70 

-0.30 

5MD227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD228 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.04 

5MD228 

A 

1 

56 

48 

1.60 

0.15 

1.15 

0.37 

5MD228 

B 

0 

34 

29 

0.89 

0.13 

0.94 

-0.20 

5MD228 

C 

0 

26 

22 

0.80 

0.16 

1.08 

-0.22 

5MD228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD229 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5MD229 

A 

1 

30 

32 

0.91 

0.17 

1.22 

0.13 

5MD229 

B 

0 

20 

21 

0.69 

0.16 

1.10 

-0.04 

5MD229 

C 

0 

45 

47 

0.68 

0.11 

1.11 

-0.09 

5MD229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD23 

* 

-1 

4655 

98 

0.88 

0.02 

0.00 

-0.11 

5MD23 

A 

1 

65 

61 

2.21 

0.15 

1.02 

0.37 

5MD23 

B 

0 

27 

25 

1.60 

0.17 

1.33 

-0.15 

5MD23 

C 

0 

14 

13 

0.93 

0.17 

0.56 

-0.33 

5MD23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD230 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5MD230 

A 

1 

62 

55 

2.01 

0.12 

1.24 

0.16 

5MD230 

B 

0 

30 

27 

1.99 

0.11 

1.34 

0.07 

5MD230 

C 

0 

21 

19 

1.39 

0.16 

0.88 

-0.29 

5MD230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD24 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.09 

5MD24 

A 

1 

53 

52 

2.07 

0.13 

1.18 

0.36 

5MD24 

B 

0 

20 

20 

1.45 

0.19 

1.03 

-0.15 

5MD24 

C 

0 

29 

28 

1.33 

0.14 

0.88 

-0.27 

5MD24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD25 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.11 

5MD25 

A 

1 

48 

44 

2.25 

0.12 

0.97 

0.39 

5MD25 

B 

0 

28 

26 

1.33 

0.13 

0.70 

-0.34 

5MD25 

C 

0 

33 

30 

1.72 

0.16 

1.32 

-0.10 

5MD25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD26 

* 

-1 

4666 

98 

0.89 

0.02 

0.00 

-0.09 

5MD26 

A 

1 

60 

63 

1.84 

0.12 

1.17 

0.19 

5MD26 

B 

0 

22 

23 

1.58 

0.18 

1.36 

-0.09 

5MD26 

C 

0 

13 

14 

1.37 

0.23 

1.33 

-0.16 

5MD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD27 

* 

-1 

4657 

98 

0.89 

0.02 

0.00 

-0.05 

5MD27 

A 

1 

53 

51 

1.75 

0.16 

1.21 

0.35 

5MD27 

B 

0 

16 

15 

0.94 

0.25 

1.33 

-0.18 

5MD27 

C 

0 

35 

34 

1.04 

0.11 

0.95 

-0.23 

5MD27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD28 

* 

-1 

4661 

98 

0.87 

0.02 

0.00 

-0.17 

5MD28 

A 

1 

59 

59 

2.77 

0.16 

1.23 

0.35 

5MD28 

B 

0 

13 

13 

1.99 

0.19 

0.90 

-0.15 

5MD28 

C 

0 

28 

28 

1.94 

0.18 

1.12 

-0.27 

5MD28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD29 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5MD29 

A 

1 

75 

60 

1.96 

0.12 

0.87 

0.44 

5MD29 

B 

0 

28 

23 

0.92 

0.12 

0.71 

-0.35 

5MD29 

C 

0 

21 

17 

1.18 

0.15 

0.98 

-0.18 

5MD29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD41 

* 

-1 

4640 

97 

0.89 

0.02 

0.00 

-0.07 

5MD41 

A 

1 

73 

60 

1.87 

0.14 

0.93 

0.46 

5MD41 

B 

0 

30 

25 

0.91 

0.11 

0.85 

-0.27 

5MD41 

C 

0 

18 

15 

0.66 

0.17 

0.72 

-0.29 

5MD41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD410 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.12 

5MD410 

A 

1 

94 

86 

2.14 

0.10 

0.86 

0.49 

5MD410 

B 

0 

2 

2 

0.40 

0.67 

0.39 

-0.19 

5MD410 

C 

0 

13 

12 

0.63 

0.19 

0.50 

-0.44 

5MD410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD411 

* 

-1 

4666 

98 

0.89 

0.02 

0.00 

-0.06 

5MD411 

A 

1 

60 

63 

1.80 

0.14 

0.93 

0.45 

5MD411 

B 

0 

15 

16 

0.88 

0.15 

0.78 

-0.24 

5MD411 

C 

0 

20 

21 

0.82 

0.13 

0.74 

-0.32 

5MD411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD412 

* 

-1 

4656 

98 

0.89 

0.02 

0.00 

-0.06 

5MD412 

A 

1 

64 

61 

1.84 

0.10 

0.80 

0.57 

5MD412 

B 

0 

11 

10 

0.89 

0.12 

0.68 

-0.22 

5MD412 

C 

0 

30 

29 

0.80 

0.11 

0.71 

-0.46 

5MD412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD413 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5MD413 

A 

1 

83 

80 

1.98 

0.13 

0.98 

0.37 

5MD413 

B 

0 

10 

10 

1.14 

0.18 

0.84 

-0.18 

5MD413 

C 

0 

11 

11 

0.71 

0.18 

0.58 

-0.32 

5MD413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD414 

* 

-1 

4646 

98 

0.89 

0.02 

0.00 

-0.04 

5MD414 

A 

1 

67 

58 

1.56 

0.12 

0.93 

0.40 

5MD414 

B 

0 

30 

26 

0.88 

0.15 

1.08 

-0.20 

5MD414 

C 

0 

18 

16 

0.53 

0.22 

0.88 

-0.29 

5MD414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD415 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5MD415 

A 

1 

42 

44 

1.14 

0.12 

0.87 

0.44 

5MD415 

B 

0 

9 

9 

0.28 

0.20 

0.73 

-0.20 

5MD415 

C 

0 

44 

46 

0.48 

0.10 

0.92 

-0.33 

5MD415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD416 

* 

-1 

4655 

98 

0.88 

0.02 

0.00 

-0.11 

5MD416 

A 

1 

76 

72 

2.23 

0.13 

0.91 

0.48 

5MD416 

B 

0 

13 

12 

1.02 

0.15 

0.62 

-0.29 

5MD416 

C 

0 

17 

16 

1.03 

0.12 

0.62 

-0.33 

5MD416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD417 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5MD417 

A 

1 

86 

76 

2.04 

0.09 

1.01 

0.33 

5MD417 

B 

0 

9 

8 

1.07 

0.16 

0.58 

-0.29 

5MD417 

C 

0 

18 

16 

1.55 

0.15 

1.02 

-0.17 

5MD417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD418 

* 

-1 

4660 

98 

0.88 

0.02 

0.00 

-0.09 

5MD418 

A 

1 

75 

74 

2.04 

0.10 

0.86 

0.56 

5MD418 

B 

0 

10 

10 

1.01 

0.22 

0.78 

-0.25 

5MD418 

C 

0 

16 

16 

0.73 

0.17 

0.54 

-0.46 

5MD418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD419 

* 

-1 

4553 

96 

0.86 

0.02 

0.00 

-0.16 

5MD419 

A 

1 

127 

61 

2.28 

0.11 

1.11 

0.40 

5MD419 

B 

0 

40 

19 

1.20 

0.16 

1.07 

-0.28 

5MD419 

C 

0 

41 

20 

1.36 

0.12 

0.91 

-0.22 

5MD419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD42 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.11 

5MD42 

A 

1 

65 

60 

2.25 

0.10 

0.82 

0.53 

5MD42 

B 

0 

27 

25 

1.52 

0.14 

0.99 

-0.21 

5MD42 

C 

0 

17 

16 

0.87 

0.15 

0.48 

-0.47 

5MD42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD420 

* 

-1 

4666 

98 

0.89 

0.02 

0.00 

-0.09 

5MD420 

A 

1 

69 

73 

1.99 

0.10 

0.91 

0.49 

5MD420 

B 

0 

18 

19 

0.97 

0.14 

0.68 

-0.41 

5MD420 

C 

0 

8 

8 

1.10 

0.17 

0.71 

-0.21 

5MD420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD43 

* 

-1 

4657 

98 

0.89 

0.02 

0.00 

-0.05 

5MD43 

A 

1 

71 

68 

1.78 

0.12 

0.88 

0.54 

5MD43 

B 

0 

27 

26 

0.52 

0.09 

0.57 

-0.48 

5MD43 

C 

0 

6 

6 

0.66 

0.13 

0.62 

-0.17 

5MD43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD44 

* 

-1 

4662 

98 

0.87 

0.02 

0.00 

-0.17 

5MD44 

A 

1 

86 

87 

2.63 

0.12 

0.89 

0.42 

5MD44 

B 

0 

8 

8 

1.25 

0.32 

0.69 

-0.31 

5MD44 

C 

0 

5 

5 

1.09 

0.36 

0.49 

-0.27 

5MD44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD45 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5MD45 

A 

1 

84 

68 

1.83 

0.12 

1.02 

0.33 

5MD45 

B 

0 

4 

3 

0.74 

0.28 

0.59 

-0.15 

5MD45 

C 

0 

36 

29 

1.14 

0.10 

0.92 

-0.28 

5MD45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD46 

* 

-1 

4640 

97 

0.89 

0.02 

0.00 

-0.07 

5MD46 

A 

1 

88 

73 

1.75 

0.12 

0.92 

0.43 

5MD46 

B 

0 

16 

13 

0.46 

0.16 

0.60 

-0.34 

5MD46 

C 

0 

17 

14 

0.86 

0.13 

0.87 

-0.21 

5MD46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD47 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.12 

5MD47 

A 

1 

88 

81 

2.19 

0.11 

0.93 

0.51 

5MD47 

B 

0 

3 

3 

0.99 

0.38 

0.62 

-0.15 

5MD47 

C 

0 

18 

17 

0.79 

0.14 

0.52 

-0.47 

5MD47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD48 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5MD48 

A 

1 

60 

64 

1.76 

0.14 

0.98 

0.40 

5MD48 

B 

0 

24 

26 

1.03 

0.15 

1.03 

-0.24 

5MD48 

C 

0 

10 

11 

0.61 

0.12 

0.55 

-0.28 

5MD48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD49 

* 

-1 

4656 

98 

0.89 

0.02 

0.00 

-0.06 

5MD49 

A 

1 

60 

57 

1.86 

0.11 

0.83 

0.55 

5MD49 

B 

0 

16 

15 

0.78 

0.12 

0.62 

-0.32 

5MD49 

C 

0 

29 

28 

0.95 

0.11 

0.77 

-0.35 

5MD49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD51 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5MD51 

A 

1 

87 

84 

1.99 

0.12 

0.88 

0.44 

5MD51 

B 

0 

2 

2 

0.45 

0.19 

0.39 

-0.16 

5MD51 

C 

0 

15 

14 

0.66 

0.19 

0.71 

-0.40 

5MD51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD510 

* 

-1 

4646 

98 

0.89 

0.02 

0.00 

-0.04 

5MD510 

A 

1 

77 

67 

1.52 

0.12 

0.99 

0.42 

5MD510 

B 

0 

25 

22 

0.52 

0.12 

0.71 

-0.37 

5MD510 

C 

0 

13 

11 

0.79 

0.21 

0.97 

-0.15 

5MD510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD511 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5MD511 

A 

1 

48 

51 

1.11 

0.12 

0.89 

0.46 

5MD511 

B 

0 

35 

37 

0.45 

0.10 

0.88 

-0.30 

5MD511 

C 

0 

12 

13 

0.22 

0.17 

0.71 

-0.26 

5MD511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD512 

* 

-1 

4656 

98 

0.88 

0.02 

0.00 

-0.11 

5MD512 

A 

1 

47 

45 

2.22 

0.18 

1.29 

0.27 

5MD512 

B 

0 

33 

31 

1.82 

0.15 

1.39 

-0.04 

5MD512 

C 

0 

25 

24 

1.35 

0.20 

1.27 

-0.27 

5MD512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD513 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5MD513 

A 

1 

86 

76 

2.10 

0.08 

0.90 

0.46 

5MD513 

B 

0 

14 

12 

1.32 

0.12 

0.74 

-0.26 

5MD513 

C 

0 

13 

12 

1.07 

0.20 

0.66 

-0.35 

5MD513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD514 

* 

-1 

4660 

98 

0.88 

0.02 

0.00 

-0.09 

5MD514 

A 

1 

43 

43 

2.02 

0.13 

1.16 

0.27 

5MD514 

B 

0 

38 

38 

1.47 

0.13 

0.98 

-0.21 

5MD514 

C 

0 

20 

20 

1.58 

0.26 

1.52 

-0.08 

5MD514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD515 

* 

-1 

4655 

98 

0.88 

0.02 

0.00 

-0.11 

5MD515 

A 

1 

36 

34 

2.42 

0.14 

0.86 

0.46 

5MD515 

B 

0 

47 

44 

1.70 

0.11 

1.02 

-0.14 

5MD515 

C 

0 

23 

22 

1.23 

0.15 

0.65 

-0.35 

5MD515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD516 

* 

-1 

4666 

98 

0.89 

0.02 

0.00 

-0.09 

5MD516 

A 

1 

39 

41 

2.16 

0.14 

0.97 

0.41 

5MD516 

B 

0 

41 

43 

1.54 

0.12 

1.05 

-0.17 

5MD516 

C 

0 

15 

16 

1.05 

0.17 

0.61 

-0.33 

5MD516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD517 

* 

-1 

4657 

98 

0.89 

0.02 

0.00 

-0.05 

5MD517 

A 

1 

33 

32 

2.10 

0.23 

1.21 

0.46 

5MD517 

B 

0 

56 

54 

1.07 

0.10 

0.83 

-0.33 

5MD517 

C 

0 

15 

14 

1.02 

0.18 

0.79 

-0.14 

5MD517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD518 

* 

-1 

4663 

98 

0.87 

0.02 

0.00 

-0.17 

5MD518 

A 

1 

73 

74 

2.78 

0.13 

0.95 

0.51 

5MD518 

B 

0 

12 

12 

1.77 

0.20 

0.80 

-0.22 

5MD518 

C 

0 

13 

13 

1.14 

0.11 

0.39 

-0.44 

5MD518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD519 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5MD519 

A 

1 

60 

48 

2.09 

0.15 

0.95 

0.46 

5MD519 

B 

0 

49 

40 

1.17 

0.10 

0.90 

-0.33 

5MD519 

C 

0 

15 

12 

0.98 

0.09 

0.62 

-0.22 

5MD519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD52 

* 

-1 

4640 

97 

0.89 

0.02 

0.00 

-0.07 

5MD52 

A 

1 

69 

57 

2.05 

0.13 

0.72 

0.61 

5MD52 

B 

0 

30 

25 

0.52 

0.09 

0.52 

-0.47 

5MD52 

C 

0 

22 

18 

0.85 

0.14 

0.80 

-0.25 

5MD52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD520 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.12 

5MD520 

A 

1 

31 

28 

2.28 

0.23 

1.75 

0.21 

5MD520 

B 

0 

63 

58 

1.95 

0.11 

1.25 

0.03 

5MD520 

C 

0 

15 

14 

1.08 

0.26 

0.58 

-0.32 

5MD520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD53 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5MD53 

A 

1 

38 

40 

1.43 

0.20 

1.60 

-0.01 

5MD53 

B 

0 

30 

32 

1.48 

0.18 

1.67 

0.02 

5MD53 

C 

0 

26 

28 

1.44 

0.16 

1.36 

-0.01 

5MD53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD54 

* 

-1 

4656 

98 

0.89 

0.02 

0.00 

-0.06 

5MD54 

A 

1 

41 

39 

1.99 

0.15 

0.95 

0.49 

5MD54 

B 

0 

16 

15 

1.32 

0.20 

1.17 

-0.06 

5MD54 

C 

0 

48 

46 

1.03 

0.08 

0.73 

-0.44 

5MD54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5MD55 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5MD55 

A 

1 

36 

35 

2.38 

0.23 

1.26 

0.39 

5MD55 

B 

0 

57 

55 

1.54 

0.11 

1.00 

-0.22 

5MD55 

C 

0 

11 

11 

0.98 

0.24 

0.54 

-0.24 

5MD55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD56 

* 

-1 

4551 

96 

0.86 

0.02 

0.00 

-0.13 

5MD56 

A 

1 

137 

65 

2.17 

0.08 

0.81 

0.58 

5MD56 

B 

0 

44 

21 

0.91 

0.10 

0.65 

-0.39 

5MD56 

C 

0 

29 

14 

0.78 

0.10 

0.55 

-0.35 

5MD56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD57 

* 

-1 

4647 

98 

0.89 

0.02 

0.00 

-0.04 

5MD57 

A 

1 

65 

57 

1.58 

0.13 

0.99 

0.40 

5MD57 

B 

0 

27 

24 

0.73 

0.13 

0.83 

-0.26 

5MD57 

C 

0 

22 

19 

0.76 

0.20 

1.09 

-0.22 

5MD57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD58 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5MD58 

A 

1 

46 

48 

1.13 

0.12 

0.88 

0.47 

5MD58 

B 

0 

31 

33 

0.27 

0.10 

0.72 

-0.43 

5MD58 

C 

0 

18 

19 

0.63 

0.14 

1.04 

-0.08 

5MD58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5MD59 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

5MD59 

A 

1 

48 

47 

2.53 

0.17 

0.91 

0.51 

5MD59 

B 

0 

29 

28 

1.17 

0.11 

0.59 

-0.41 

5MD59 

C 

0 

26 

25 

1.61 

0.18 

1.10 

-0.16 

5MD59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT11 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT11 

A 

1 

32 

28 

2.06 

0.18 

1.54 

0.13 

5NBT11 

B 

0 

56 

50 

1.92 

0.10 

1.19 

0.04 

5NBT11 

C 

0 

25 

22 

1.58 

0.15 

0.85 

-0.19 

5NBT11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT110 

* 

-1 

4660 

98 

0.88 

0.02 

0.00 

-0.09 

5NBT110 

A 

1 

73 

72 

1.96 

0.10 

0.97 

0.40 

5NBT110 

B 

0 

7 

7 

1.32 

0.46 

1.47 

-0.12 

5NBT110 

C 

0 

21 

21 

1.05 

0.18 

0.82 

-0.37 

5NBT110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT111 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT111 

A 

1 

71 

69 

2.21 

0.10 

0.82 

0.58 

5NBT111 

B 

0 

18 

17 

0.93 

0.15 

0.56 

-0.46 

5NBT111 

C 

0 

14 

14 

1.22 

0.13 

0.68 

-0.27 

5NBT111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT112 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NBT112 

A 

1 

64 

68 

1.94 

0.10 

0.92 

0.38 

5NBT112 

B 

0 

10 

11 

1.15 

0.25 

1.01 

-0.22 

5NBT112 

C 

0 

20 

21 

1.24 

0.21 

1.20 

-0.27 

5NBT112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT113 

* 

-1 

4658 

98 

0.89 

0.02 

0.00 

-0.05 

5NBT113 

A 

1 

32 

31 

1.94 

0.22 

1.21 

0.34 

5NBT113 

B 

0 

26 

25 

1.16 

0.20 

1.09 

-0.13 

5NBT113 

C 

0 

45 

44 

1.13 

0.12 

1.03 

-0.21 

5NBT113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT114 

* 

-1 

4663 

98 

0.87 

0.02 

0.00 

-0.17 

5NBT114 

A 

1 

81 

83 

2.62 

0.12 

1.00 

0.34 

5NBT114 

B 

0 

12 

12 

1.41 

0.28 

0.88 

-0.33 

5NBT114 

C 

0 

5 

5 

2.02 

0.43 

1.36 

-0.08 

5NBT114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT115 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5NBT115 

A 

1 

18 

15 

2.39 

0.41 

1.39 

0.32 

5NBT115 

B 

0 

32 

26 

1.37 

0.17 

1.12 

-0.13 

5NBT115 

C 

0 

74 

60 

1.50 

0.09 

0.94 

-0.11 

5NBT115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT12 

* 

-1 

4641 

97 

0.89 

0.02 

0.00 

-0.07 

5NBT12 

A 

1 

50 

42 

1.68 

0.19 

1.41 

0.16 

5NBT12 

B 

0 

40 

33 

1.29 

0.13 

1.22 

-0.11 

5NBT12 

C 

0 

30 

25 

1.34 

0.19 

1.53 

-0.06 

5NBT12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT13 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.12 

5NBT13 

A 

1 

57 

52 

2.31 

0.14 

1.15 

0.38 

5NBT13 

B 

0 

27 

25 

1.83 

0.15 

1.31 

-0.05 

5NBT13 

C 

0 

25 

23 

1.15 

0.18 

0.69 

-0.39 

5NBT13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT14 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT14 

A 

1 

56 

60 

1.67 

0.15 

1.08 

0.27 

5NBT14 

B 

0 

26 

28 

1.35 

0.15 

1.38 

-0.06 

5NBT14 

C 

0 

12 

13 

0.63 

0.21 

0.69 

-0.31 

5NBT14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT15 

* 

-1 

4657 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT15 

A 

1 

25 

24 

1.54 

0.20 

1.50 

0.06 

5NBT15 

B 

0 

61 

59 

1.51 

0.11 

1.32 

0.08 

5NBT15 

C 

0 

18 

17 

1.14 

0.14 

0.72 

-0.16 

5NBT15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT16 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT16 

A 

1 

42 

40 

2.33 

0.19 

1.11 

0.40 

5NBT16 

B 

0 

47 

45 

1.57 

0.13 

1.43 

-0.16 

5NBT16 

C 

0 

15 

14 

0.81 

0.23 

0.62 

-0.34 

5NBT16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT17 

* 

-1 

4535 

95 

0.86 

0.02 

0.00 

-0.15 

5NBT17 

A 

1 

146 

65 

2.00 

0.07 

1.02 

0.29 

5NBT17 

B 

0 

46 

20 

1.48 

0.16 

1.37 

-0.17 

5NBT17 

C 

0 

34 

15 

1.37 

0.15 

1.05 

-0.20 

5NBT17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT18 

* 

-1 

4648 

98 

0.89 

0.02 

0.00 

-0.04 

5NBT18 

A 

1 

91 

81 

1.43 

0.10 

0.92 

0.41 

5NBT18 

B 

0 

13 

12 

0.41 

0.24 

0.83 

-0.29 

5NBT18 

C 

0 

9 

8 

0.35 

0.20 

0.66 

-0.25 

5NBT18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT19 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5NBT19 

A 

1 

72 

76 

0.93 

0.09 

0.93 

0.41 

5NBT19 

B 

0 

13 

14 

0.33 

0.18 

0.91 

-0.22 

5NBT19 

C 

0 

10 

11 

0.01 

0.10 

0.57 

-0.33 

5NBT19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT21 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT21 

A 

1 

85 

83 

2.10 

0.12 

0.93 

0.36 

5NBT21 

B 

0 

8 

8 

1.48 

0.34 

1.45 

-0.11 

5NBT21 

C 

0 

10 

10 

0.68 

0.14 

0.44 

-0.36 

5NBT21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT210 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT210 

A 

1 

96 

85 

2.01 

0.08 

0.95 

0.36 

5NBT210 

B 

0 

16 

14 

1.21 

0.14 

0.72 

-0.33 

5NBT210 

C 

0 

1 

1 

0.71 

0.00 

0.38 

-0.13 

5NBT210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT211 

* 

-1 

4660 

98 

0.88 

0.02 

0.00 

-0.09 

5NBT211 

A 

1 

27 

27 

2.19 

0.20 

1.51 

0.29 

5NBT211 

B 

0 

50 

50 

1.54 

0.10 

0.88 

-0.20 

5NBT211 

C 

0 

24 

24 

1.60 

0.22 

1.28 

-0.08 

5NBT211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT212 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT212 

A 

1 

79 

77 

2.02 

0.10 

1.01 

0.34 

5NBT212 

B 

0 

17 

17 

1.24 

0.16 

0.84 

-0.30 

5NBT212 

C 

0 

7 

7 

1.38 

0.41 

1.34 

-0.14 

5NBT212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Fifth Grade Math Measure Development 


450 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT213 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NBT213 

A 

1 

83 

88 

1.81 

0.10 

0.95 

0.32 

5NBT213 

B 

0 

10 

11 

1.03 

0.20 

0.80 

-0.26 

5NBT213 

C 

0 

1 

1 

-0.10 

0.00 

0.22 

-0.21 

5NBT213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT214 

* 

-1 

4658 

98 

0.89 

0.02 

0.00 

-0.05 

5NBT214 

A 

1 

93 

90 

1.51 

0.11 

0.94 

0.34 

5NBT214 

B 

0 

3 

3 

0.11 

0.19 

0.42 

-0.21 

5NBT214 

C 

0 

7 

7 

0.35 

0.23 

0.62 

-0.26 

5NBT214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT215 

* 

-1 

4663 

98 

0.87 

0.02 

0.00 

-0.17 

5NBT215 

A 

1 

93 

95 

2.52 

0.12 

0.96 

0.29 

5NBT215 

B 

0 

2 

2 

0.41 

0.00 

0.22 

-0.25 

5NBT215 

C 

0 

3 

3 

1.37 

0.29 

0.62 

-0.17 

5NBT215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT22 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5NBT22 

A 

1 

90 

73 

1.82 

0.12 

1.00 

0.37 

5NBT22 

B 

0 

16 

13 

0.98 

0.11 

0.74 

-0.23 

5NBT22 

C 

0 

18 

15 

0.97 

0.09 

0.71 

-0.25 

5NBT22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT23 

* 

-1 

4641 

97 

0.89 

0.02 

0.00 

-0.07 

5NBT23 

A 

1 

70 

58 

1.85 

0.14 

0.95 

0.41 

5NBT23 

B 

0 

22 

18 

0.82 

0.15 

0.78 

-0.27 

5NBT23 

C 

0 

28 

23 

0.99 

0.15 

1.01 

-0.23 

5NBT23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT24 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.12 

5NBT24 

A 

1 

87 

80 

2.17 

0.11 

0.90 

0.46 

5NBT24 

B 

0 

9 

8 

1.07 

0.39 

1.08 

-0.24 

5NBT24 

C 

0 

13 

12 

0.86 

0.18 

0.56 

-0.37 

5NBT24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Fifth Grade Math Measure Development 


451 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT25 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT25 

A 

1 

77 

82 

1.66 

0.11 

0.91 

0.44 

5NBT25 

B 

0 

12 

13 

0.60 

0.11 

0.61 

-0.32 

5NBT25 

C 

0 

5 

5 

0.26 

0.15 

0.42 

-0.28 

5NBT25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT26 

* 

-1 

4657 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT26 

A 

1 

93 

89 

1.51 

0.09 

1.00 

0.21 

5NBT26 

B 

0 

5 

5 

0.50 

0.27 

0.57 

-0.24 

5NBT26 

C 

0 

6 

6 

1.25 

0.12 

1.10 

-0.06 

5NBT26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT27 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT27 

A 

1 

92 

88 

1.93 

0.12 

0.90 

0.40 

5NBT27 

B 

0 

8 

8 

0.65 

0.20 

0.56 

-0.28 

5NBT27 

C 

0 

4 

4 

0.19 

0.17 

0.32 

-0.28 

5NBT27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT28 

* 

-1 

4648 

98 

0.89 

0.02 

0.00 

-0.04 

5NBT28 

A 

1 

100 

88 

1.36 

0.10 

0.95 

0.35 

5NBT28 

B 

0 

7 

6 

0.23 

0.28 

0.65 

-0.25 

5NBT28 

C 

0 

6 

5 

0.25 

0.19 

0.58 

-0.23 

5NBT28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT29 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5NBT29 

A 

1 

72 

76 

0.96 

0.09 

0.88 

0.47 

5NBT29 

B 

0 

12 

13 

0.40 

0.15 

0.91 

-0.17 

5NBT29 

C 

0 

11 

12 

-0.21 

0.08 

0.45 

-0.45 

5NBT29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT31 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT31 

A 

1 

53 

51 

2.46 

0.16 

0.88 

0.50 

5NBT31 

B 

0 

17 

17 

1.09 

0.16 

0.59 

-0.33 

5NBT31 

C 

0 

33 

32 

1.45 

0.15 

1.03 

-0.28 

5NBT31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT310 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT310 

A 

1 

67 

59 

2.22 

0.10 

0.93 

0.48 

5NBT310 

B 

0 

36 

32 

1.44 

0.09 

0.78 

-0.37 

5NBT310 

C 

0 

10 

9 

1.30 

0.18 

0.70 

-0.22 

5NBT310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT311 

* 

-1 

4660 

98 

0.88 

0.02 

0.00 

-0.09 

5NBT311 

A 

1 

48 

48 

2.27 

0.12 

0.85 

0.54 

5NBT311 

B 

0 

13 

13 

0.75 

0.24 

0.53 

-0.40 

5NBT311 

C 

0 

40 

40 

1.40 

0.11 

0.92 

-0.28 

5NBT311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT312 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT312 

A 

1 

71 

70 

2.18 

0.10 

0.86 

0.55 

5NBT312 

B 

0 

18 

18 

1.18 

0.15 

0.73 

-0.33 

5NBT312 

C 

0 

13 

13 

0.93 

0.15 

0.52 

-0.38 

5NBT312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT313 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NBT313 

A 

1 

41 

44 

2.06 

0.16 

1.15 

0.34 

5NBT313 

B 

0 

42 

45 

1.56 

0.10 

1.03 

-0.15 

5NBT313 

C 

0 

11 

12 

0.98 

0.23 

0.60 

-0.30 

5NBT313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT314 

* 

-1 

4658 

98 

0.89 

0.02 

0.00 

-0.05 

5NBT314 

A 

1 

85 

83 

1.55 

0.12 

0.97 

0.34 

5NBT314 

B 

0 

13 

13 

0.70 

0.21 

0.90 

-0.24 

5NBT314 

C 

0 

5 

5 

0.38 

0.18 

0.53 

-0.21 

5NBT314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT315 

* 

-1 

4663 

98 

0.87 

0.02 

0.00 

-0.17 

5NBT315 

A 

1 

93 

95 

2.51 

0.12 

0.99 

0.27 

5NBT315 

B 

0 

5 

5 

1.12 

0.24 

0.49 

-0.27 

5NBT315 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT316 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5NBT316 

A 

1 

49 

40 

2.14 

0.18 

0.94 

0.43 

5NBT316 

B 

0 

47 

38 

1.27 

0.10 

0.93 

-0.24 

5NBT316 

C 

0 

28 

23 

1.17 

0.14 

0.86 

-0.22 

5NBT316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT317 

* 

-1 

4641 

97 

0.89 

0.02 

0.00 

-0.07 

5NBT317 

A 

1 

51 

43 

2.03 

0.18 

1.01 

0.43 

5NBT317 

B 

0 

45 

38 

0.99 

0.10 

0.81 

-0.33 

5NBT317 

C 

0 

24 

20 

1.14 

0.18 

1.12 

-0.14 

5NBT317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT318 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.12 

5NBT318 

A 

1 

78 

72 

2.27 

0.11 

0.98 

0.52 

5NBT318 

B 

0 

10 

9 

1.25 

0.25 

0.82 

-0.20 

5NBT318 

C 

0 

21 

19 

0.95 

0.14 

0.59 

-0.44 

5NBT318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT319 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT319 

A 

1 

64 

68 

1.71 

0.13 

0.93 

0.36 

5NBT319 

B 

0 

14 

15 

0.64 

0.22 

0.79 

-0.33 

5NBT319 

C 

0 

16 

17 

1.13 

0.19 

1.15 

-0.14 

5NBT319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT32 

* 

-1 

4657 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT32 

A 

1 

65 

63 

1.58 

0.11 

1.12 

0.19 

5NBT32 

B 

0 

8 

8 

0.94 

0.29 

1.00 

-0.17 

5NBT32 

C 

0 

31 

30 

1.30 

0.15 

1.53 

-0.11 

5NBT32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT320 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT320 

A 

1 

81 

78 

2.03 

0.12 

0.90 

0.43 

5NBT320 

B 

0 

8 

8 

0.92 

0.20 

0.66 

-0.21 

5NBT320 

C 

0 

15 

14 

0.80 

0.22 

0.78 

-0.35 

5NBT320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT33 

* 

-1 

4648 

98 

0.89 

0.02 

0.00 

-0.04 

5NBT33 

A 

1 

57 

50 

1.66 

0.14 

0.99 

0.43 

5NBT33 

B 

0 

46 

41 

0.93 

0.11 

1.11 

-0.24 

5NBT33 

C 

0 

10 

9 

0.14 

0.19 

0.43 

-0.33 

5NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT34 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5NBT34 

A 

1 

39 

41 

1.06 

0.14 

1.03 

0.33 

5NBT34 

B 

0 

39 

41 

0.68 

0.09 

1.07 

-0.08 

5NBT34 

C 

0 

17 

18 

0.22 

0.15 

0.70 

-0.32 

5NBT34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT35 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT35 

A 

1 

41 

40 

2.34 

0.18 

1.16 

0.30 

5NBT35 

B 

0 

29 

28 

1.76 

0.21 

2.34 

-0.08 

5NBT35 

C 

0 

33 

32 

1.52 

0.17 

1.12 

-0.24 

5NBT35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT36 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT36 

A 

1 

53 

47 

2.30 

0.12 

0.91 

0.47 

5NBT36 

B 

0 

38 

34 

1.57 

0.10 

0.87 

-0.27 

5NBT36 

C 

0 

22 

19 

1.43 

0.14 

0.79 

-0.27 

5NBT36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT37 

* 

-1 

4660 

98 

0.88 

0.02 

0.00 

-0.09 

5NBT37 

A 

1 

89 

88 

1.84 

0.09 

0.93 

0.32 

5NBT37 

B 

0 

6 

6 

1.54 

0.47 

1.58 

-0.05 

5NBT37 

C 

0 

6 

6 

0.26 

0.18 

0.34 

-0.39 

5NBT37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT38 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT38 

A 

1 

36 

35 

2.23 

0.16 

1.18 

0.31 

5NBT38 

B 

0 

43 

42 

1.71 

0.13 

1.12 

-0.12 

5NBT38 

C 

0 

23 

23 

1.48 

0.14 

0.77 

-0.21 

5NBT38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT39 

* 

-1 

4433 

93 

0.86 

0.02 

0.00 

-0.13 

5NBT39 

A 

1 

158 

48 

2.09 

0.09 

0.98 

0.52 

5NBT39 

B 

0 

8 

2 

0.56 

0.28 

0.52 

-0.14 

5NBT39 

C 

0 

162 

49 

1.01 

0.05 

0.74 

-0.48 

5NBT39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT41 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NBT41 

A 

1 

49 

52 

2.18 

0.12 

0.85 

0.56 

5NBT41 

B 

0 

20 

21 

1.05 

0.15 

0.70 

-0.39 

5NBT41 

C 

0 

25 

27 

1.31 

0.11 

0.80 

-0.27 

5NBT41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT410 

* 

-1 

4658 

98 

0.89 

0.02 

0.00 

-0.05 

5NBT410 

A 

1 

60 

58 

1.82 

0.14 

0.96 

0.48 

5NBT410 

B 

0 

4 

4 

0.93 

0.38 

0.87 

-0.09 

5NBT410 

C 

0 

39 

38 

0.77 

0.10 

0.77 

-0.45 

5NBT410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT411 

* 

-1 

4663 

98 

0.87 

0.02 

0.00 

-0.17 

5NBT411 

A 

1 

73 

74 

2.61 

0.14 

1.17 

0.25 

5NBT411 

B 

0 

17 

17 

1.86 

0.22 

1.04 

-0.23 

5NBT411 

C 

0 

8 

8 

2.12 

0.32 

1.44 

-0.08 

5NBT411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT412 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5NBT412 

A 

1 

63 

51 

2.09 

0.15 

0.92 

0.49 

5NBT412 

B 

0 

35 

28 

1.12 

0.09 

0.76 

-0.29 

5NBT412 

C 

0 

26 

21 

1.03 

0.11 

0.74 

-0.28 

5NBT412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT413 

* 

-1 

4642 

98 

0.89 

0.02 

0.00 

-0.07 

5NBT413 

A 

1 

66 

55 

1.87 

0.15 

1.01 

0.41 

5NBT413 

B 

0 

20 

17 

0.96 

0.16 

0.93 

-0.20 

5NBT413 

C 

0 

33 

28 

0.92 

0.12 

0.85 

-0.30 

5NBT413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT414 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.12 

5NBT414 

A 

1 

59 

54 

2.24 

0.15 

1.38 

0.32 

5NBT414 

B 

0 

32 

29 

1.53 

0.12 

0.86 

-0.24 

5NBT414 

C 

0 

18 

17 

1.58 

0.25 

1.29 

-0.14 

5NBT414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT415 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT415 

A 

1 

40 

43 

2.01 

0.18 

0.89 

0.47 

5NBT415 

B 

0 

21 

22 

0.74 

0.14 

0.61 

-0.37 

5NBT415 

C 

0 

33 

35 

1.22 

0.12 

1.03 

-0.17 

5NBT415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT42 

* 

-1 

4657 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT42 

A 

1 

66 

63 

1.65 

0.11 

1.01 

0.29 

5NBT42 

B 

0 

22 

21 

1.20 

0.19 

1.31 

-0.15 

5NBT42 

C 

0 

16 

15 

0.99 

0.16 

0.85 

-0.22 

5NBT42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT43 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT43 

A 

1 

59 

57 

2.17 

0.16 

1.07 

0.40 

5NBT43 

B 

0 

27 

26 

1.47 

0.14 

1.08 

-0.15 

5NBT43 

C 

0 

18 

17 

0.91 

0.18 

0.64 

-0.34 

5NBT43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT44 

* 

-1 

4648 

98 

0.89 

0.02 

0.00 

-0.04 

5NBT44 

A 

1 

52 

46 

1.39 

0.17 

1.51 

0.14 

5NBT44 

B 

0 

42 

37 

1.20 

0.12 

1.37 

-0.02 

5NBT44 

C 

0 

19 

17 

0.86 

0.19 

0.93 

-0.16 

5NBT44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT45 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5NBT45 

A 

1 

21 

22 

1.15 

0.22 

1.12 

0.27 

5NBT45 

B 

0 

43 

45 

0.69 

0.11 

1.06 

-0.07 

5NBT45 

C 

0 

31 

33 

0.58 

0.10 

0.85 

-0.16 

5NBT45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT46 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT46 

A 

1 

59 

58 

2.41 

0.15 

0.95 

0.51 

5NBT46 

B 

0 

25 

25 

1.34 

0.12 

0.77 

-0.30 

5NBT46 

C 

0 

18 

18 

1.16 

0.14 

0.62 

-0.32 

5NBT46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT47 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT47 

A 

1 

54 

48 

2.22 

0.11 

0.97 

0.38 

5NBT47 

B 

0 

34 

30 

1.49 

0.13 

0.95 

-0.31 

5NBT47 

C 

0 

25 

22 

1.70 

0.14 

1.05 

-0.12 

5NBT47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT48 

* 

-1 

4660 

98 

0.88 

0.02 

0.00 

-0.09 

5NBT48 

A 

1 

51 

50 

2.32 

0.10 

0.75 

0.63 

5NBT48 

B 

0 

11 

11 

0.87 

0.30 

0.71 

-0.32 

5NBT48 

C 

0 

39 

39 

1.20 

0.11 

0.73 

-0.44 

5NBT48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT49 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT49 

A 

1 

50 

49 

2.23 

0.12 

0.97 

0.41 

5NBT49 

B 

0 

14 

14 

1.48 

0.24 

1.00 

-0.16 

5NBT49 

C 

0 

38 

37 

1.47 

0.13 

0.92 

-0.32 

5NBT49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT51 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NBT51 

A 

1 

80 

85 

1.83 

0.10 

0.97 

0.33 

5NBT51 

B 

0 

7 

7 

0.73 

0.20 

0.54 

-0.31 

5NBT51 

C 

0 

7 

7 

1.29 

0.28 

1.07 

-0.13 

5NBT51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT510 

* 

-1 

4659 

98 

0.89 

0.02 

0.00 

-0.05 

5NBT510 

A 

1 

64 

63 

1.76 

0.13 

0.89 

0.44 

5NBT510 

B 

0 

19 

19 

0.82 

0.19 

1.07 

-0.26 

5NBT510 

C 

0 

19 

19 

0.76 

0.23 

1.16 

-0.29 

5NBT510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT511 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

5NBT511 

A 

1 

70 

72 

2.71 

0.14 

1.08 

0.39 

5NBT511 

B 

0 

17 

18 

1.80 

0.17 

0.83 

-0.26 

5NBT511 

C 

0 

10 

10 

1.59 

0.31 

0.89 

-0.25 

5NBT511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT512 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5NBT512 

A 

1 

71 

57 

1.88 

0.14 

1.03 

0.32 

5NBT512 

B 

0 

33 

27 

1.23 

0.12 

1.02 

-0.21 

5NBT512 

C 

0 

20 

16 

1.18 

0.17 

0.97 

-0.17 

5NBT512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT513 

* 

-1 

4643 

98 

0.89 

0.02 

0.00 

-0.07 

5NBT513 

A 

1 

86 

73 

1.75 

0.12 

0.95 

0.42 

5NBT513 

B 

0 

11 

9 

0.91 

0.21 

0.94 

-0.16 

5NBT513 

C 

0 

21 

18 

0.58 

0.11 

0.62 

-0.37 

5NBT513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT514 

* 

-1 

4652 

98 

0.88 

0.02 

0.00 

-0.12 

5NBT514 

A 

1 

88 

81 

2.18 

0.11 

0.97 

0.49 

5NBT514 

B 

0 

15 

14 

1.00 

0.15 

0.65 

-0.35 

5NBT514 

C 

0 

6 

6 

0.49 

0.12 

0.34 

-0.32 

5NBT514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT515 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT515 

A 

1 

60 

64 

1.78 

0.13 

0.91 

0.43 

5NBT515 

B 

0 

9 

10 

0.58 

0.15 

0.54 

-0.28 

5NBT515 

C 

0 

25 

27 

0.97 

0.15 

0.95 

-0.28 

5NBT515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT516 

* 

-1 

4658 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT516 

A 

1 

58 

56 

1.85 

0.11 

0.84 

0.50 

5NBT516 

B 

0 

15 

15 

0.99 

0.12 

0.74 

-0.22 

5NBT516 

C 

0 

30 

29 

0.95 

0.14 

0.85 

-0.37 

5NBT516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT517 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT517 

A 

1 

90 

87 

1.92 

0.12 

0.93 

0.34 

5NBT517 

B 

0 

5 

5 

0.65 

0.41 

0.67 

-0.22 

5NBT517 

C 

0 

9 

9 

0.84 

0.24 

0.74 

-0.25 

5NBT517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT518 

* 

-1 

4524 

95 

0.86 

0.02 

0.00 

-0.14 

5NBT518 

A 

1 

174 

73 

1.98 

0.08 

0.97 

0.41 

5NBT518 

B 

0 

24 

10 

0.83 

0.11 

0.64 

-0.26 

5NBT518 

C 

0 

39 

16 

0.98 

0.15 

1.07 

-0.28 

5NBT518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT519 

* 

-1 

4648 

98 

0.89 

0.02 

0.00 

-0.04 

5NBT519 

A 

1 

82 

73 

1.49 

0.11 

0.96 

0.42 

5NBT519 

B 

0 

14 

12 

0.76 

0.23 

1.08 

-0.17 

5NBT519 

C 

0 

17 

15 

0.35 

0.12 

0.58 

-0.36 

5NBT519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT52 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5NBT52 

A 

1 

63 

66 

1.01 

0.10 

0.90 

0.46 

5NBT52 

B 

0 

16 

17 

0.03 

0.13 

0.63 

-0.42 

5NBT52 

C 

0 

16 

17 

0.46 

0.12 

0.93 

-0.17 

5NBT52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT520 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT520 

A 

1 

73 

74 

2.20 

0.14 

1.04 

0.37 

5NBT520 

B 

0 

11 

11 

1.50 

0.23 

1.07 

-0.14 

5NBT520 

C 

0 

15 

15 

1.10 

0.11 

0.61 

-0.32 

5NBT520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT53 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT53 

A 

1 

97 

86 

2.04 

0.08 

0.88 

0.46 

5NBT53 

B 

0 

10 

9 

0.94 

0.21 

0.60 

-0.35 

5NBT53 

C 

0 

6 

5 

0.94 

0.17 

0.52 

-0.27 

5NBT53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Fifth Grade Math Measure Development 


460 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT54 

* 

-1 

4660 

98 

0.88 

0.02 

0.00 

-0.09 

5NBT54 

A 

1 

69 

68 

2.03 

0.11 

0.99 

0.47 

5NBT54 

B 

0 

11 

11 

0.88 

0.22 

0.63 

-0.31 

5NBT54 

C 

0 

21 

21 

1.19 

0.17 

0.92 

-0.29 

5NBT54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT55 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT55 

A 

1 

80 

81 

2.03 

0.10 

0.96 

0.34 

5NBT55 

B 

0 

9 

9 

0.94 

0.19 

0.56 

-0.33 

5NBT55 

C 

0 

10 

10 

1.51 

0.31 

1.38 

-0.13 

5NBT55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT56 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NBT56 

A 

1 

67 

71 

1.97 

0.11 

0.92 

0.47 

5NBT56 

B 

0 

11 

12 

1.27 

0.16 

0.85 

-0.18 

5NBT56 

C 

0 

16 

17 

0.90 

0.14 

0.61 

-0.41 

5NBT56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT57 

* 

-1 

4660 

98 

0.89 

0.02 

0.00 

-0.05 

5NBT57 

A 

1 

63 

62 

1.56 

0.13 

1.12 

0.21 

5NBT57 

B 

0 

17 

17 

0.77 

0.23 

1.16 

-0.26 

5NBT57 

C 

0 

21 

21 

1.35 

0.23 

2.11 

-0.02 

5NBT57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT58 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

5NBT58 

A 

1 

62 

64 

2.84 

0.14 

1.01 

0.47 

5NBT58 

B 

0 

14 

14 

1.90 

0.26 

1.17 

-0.19 

5NBT58 

C 

0 

21 

22 

1.60 

0.17 

0.73 

-0.38 

5NBT58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT59 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5NBT59 

A 

1 

85 

69 

1.82 

0.12 

0.97 

0.33 

5NBT59 

B 

0 

18 

15 

1.02 

0.13 

0.78 

-0.23 

5NBT59 

C 

0 

21 

17 

1.15 

0.18 

1.18 

-0.20 

5NBT59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT61 

* 

-1 

4643 

98 

0.89 

0.02 

0.00 

-0.07 

5NBT61 

A 

1 

49 

42 

1.70 

0.20 

1.47 

0.18 

5NBT61 

B 

0 

24 

20 

1.02 

0.18 

1.06 

-0.20 

5NBT61 

C 

0 

45 

38 

1.43 

0.12 

1.42 

-0.02 

5NBT61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT610 

* 

-1 

4653 

98 

0.88 

0.02 

0.00 

-0.12 

5NBT610 

A 

1 

76 

70 

2.14 

0.12 

1.18 

0.30 

5NBT610 

B 

0 

25 

23 

1.61 

0.19 

1.53 

-0.16 

5NBT610 

C 

0 

7 

6 

0.78 

0.25 

0.48 

-0.28 

5NBT610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT611 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT611 

A 

1 

58 

62 

1.70 

0.15 

1.10 

0.30 

5NBT611 

B 

0 

19 

20 

0.97 

0.14 

0.85 

-0.24 

5NBT611 

C 

0 

17 

18 

1.15 

0.17 

1.10 

-0.14 

5NBT611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT612 

* 

-1 

4658 

98 

0.89 

0.02 

0.00 

-0.06 

5NBT612 

A 

1 

56 

54 

1.76 

0.12 

0.99 

0.37 

5NBT612 

B 

0 

26 

25 

1.17 

0.13 

0.99 

-0.19 

5NBT612 

C 

0 

21 

20 

1.02 

0.16 

0.88 

-0.25 

5NBT612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT613 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT613 

A 

1 

77 

74 

2.02 

0.13 

0.99 

0.38 

5NBT613 

B 

0 

10 

10 

0.98 

0.24 

0.84 

-0.22 

5NBT613 

C 

0 

17 

16 

1.08 

0.19 

0.87 

-0.27 

5NBT613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT614 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

5NBT614 

A 

1 

53 

47 

1.65 

0.15 

1.03 

0.39 

5NBT614 

B 

0 

21 

19 

1.10 

0.17 

1.20 

-0.06 

5NBT614 

C 

0 

38 

34 

0.71 

0.13 

0.83 

-0.36 

5NBT614 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Fifth Grade Math Measure Development 


462 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT615 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5NBT615 

A 

1 

62 

65 

1.03 

0.10 

0.89 

0.48 

5NBT615 

B 

0 

15 

16 

0.19 

0.16 

0.76 

-0.31 

5NBT615 

C 

0 

18 

19 

0.29 

0.11 

0.75 

-0.29 

5NBT615 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT62 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT62 

A 

1 

57 

58 

2.47 

0.14 

0.80 

0.54 

5NBT62 

B 

0 

28 

28 

1.30 

0.16 

0.96 

-0.37 

5NBT62 

C 

0 

14 

14 

1.16 

0.20 

0.72 

-0.29 

5NBT62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT63 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5NBT63 

A 

1 

90 

80 

2.05 

0.09 

0.98 

0.40 

5NBT63 

B 

0 

13 

12 

1.27 

0.13 

0.73 

-0.27 

5NBT63 

C 

0 

10 

9 

1.18 

0.15 

0.67 

-0.26 

5NBT63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT64 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

5NBT64 

A 

1 

71 

72 

2.05 

0.10 

0.86 

0.53 

5NBT64 

B 

0 

20 

20 

1.16 

0.14 

0.81 

-0.30 

5NBT64 

C 

0 

8 

8 

0.34 

0.27 

0.39 

-0.43 

5NBT64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT65 

* 

-1 

4663 

98 

0.88 

0.02 

0.00 

-0.10 

5NBT65 

A 

1 

55 

56 

2.12 

0.12 

1.06 

0.33 

5NBT65 

B 

0 

10 

10 

1.34 

0.36 

1.19 

-0.19 

5NBT65 

C 

0 

33 

34 

1.58 

0.12 

1.02 

-0.22 

5NBT65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT66 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NBT66 

A 

1 

53 

56 

1.99 

0.13 

1.03 

0.36 

5NBT66 

B 

0 

13 

14 

1.16 

0.21 

0.79 

-0.25 

5NBT66 

C 

0 

28 

30 

1.43 

0.13 

1.02 

-0.20 

5NBT66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS Fifth Grade Math Measure Development 


463 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NBT67 

* 

-1 

4660 

98 

0.89 

0.02 

0.00 

-0.05 

5NBT67 

A 

1 

31 

31 

2.14 

0.20 

0.95 

0.48 

5NBT67 

B 

0 

18 

18 

0.96 

0.19 

0.88 

-0.19 

5NBT67 

C 

0 

52 

51 

1.08 

0.12 

0.95 

-0.30 

5NBT67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT68 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

5NBT68 

A 

1 

45 

46 

2.87 

0.16 

1.07 

0.35 

5NBT68 

B 

0 

14 

14 

2.25 

0.26 

1.20 

-0.06 

5NBT68 

C 

0 

38 

39 

1.98 

0.19 

1.49 

-0.31 

5NBT68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NBT69 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5NBT69 

A 

1 

68 

55 

2.00 

0.14 

0.96 

0.43 

5NBT69 

B 

0 

33 

27 

0.93 

0.09 

0.65 

-0.39 

5NBT69 

C 

0 

23 

19 

1.35 

0.12 

1.07 

-0.11 

5NBT69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF21 

* 

-1 

4644 

98 

0.89 

0.02 

0.00 

-0.07 

5NF21 

A 

1 

51 

44 

2.11 

0.17 

0.86 

0.51 

5NF21 

B 

0 

24 

21 

0.98 

0.18 

0.96 

-0.21 

5NF21 

C 

0 

42 

36 

0.93 

0.09 

0.73 

-0.35 

5NF21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF210 

* 

-1 

4653 

98 

0.88 

0.02 

0.00 

-0.12 

5NF210 

A 

1 

62 

57 

2.54 

0.10 

0.66 

0.66 

5NF210 

B 

0 

32 

30 

1.19 

0.15 

0.87 

-0.45 

5NF210 

C 

0 

14 

13 

0.91 

0.22 

0.54 

-0.37 

5NF210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF211 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5NF211 

A 

1 

52 

55 

1.86 

0.16 

0.99 

0.45 

5NF211 

B 

0 

23 

24 

1.08 

0.11 

0.87 

-0.21 

5NF211 

C 

0 

19 

20 

0.77 

0.13 

0.66 

-0.33 

5NF211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF212 

* 

-1 

4659 

98 

0.89 

0.02 

0.00 

-0.06 

5NF212 

A 

1 

55 

54 

1.73 

0.12 

1.01 

0.35 

5NF212 

B 

0 

27 

26 

0.97 

0.12 

0.78 

-0.33 

5NF212 

C 

0 

20 

20 

1.33 

0.19 

1.62 

-0.07 

5NF212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF213 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NF213 

A 

1 

65 

63 

2.14 

0.14 

0.97 

0.42 

5NF213 

B 

0 

16 

15 

1.17 

0.26 

1.25 

-0.22 

5NF213 

C 

0 

23 

22 

1.13 

0.14 

0.79 

-0.30 

5NF213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF214 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

5NF214 

A 

1 

66 

59 

1.68 

0.12 

0.87 

0.53 

5NF214 

B 

0 

21 

19 

0.66 

0.17 

0.85 

-0.27 

5NF214 

C 

0 

25 

22 

0.51 

0.12 

0.66 

-0.38 

5NF214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF215 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5NF215 

A 

1 

26 

27 

1.01 

0.21 

1.29 

0.20 

5NF215 

B 

0 

19 

20 

0.70 

0.15 

1.06 

-0.04 

5NF215 

C 

0 

50 

53 

0.64 

0.09 

0.98 

-0.15 

5NF215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF22 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.11 

5NF22 

A 

1 

33 

33 

2.44 

0.26 

1.61 

0.31 

5NF22 

B 

0 

30 

30 

1.68 

0.15 

0.97 

-0.16 

5NF22 

C 

0 

36 

36 

1.74 

0.13 

0.93 

-0.15 

5NF22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF23 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

5NF23 

A 

1 

43 

38 

2.14 

0.12 

1.08 

0.23 

5NF23 

B 

0 

39 

35 

1.81 

0.15 

1.54 

-0.07 

5NF23 

C 

0 

31 

27 

1.64 

0.14 

0.96 

-0.18 

5NF23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF24 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

5NF24 

A 

1 

72 

73 

2.09 

0.09 

0.81 

0.61 

5NF24 

B 

0 

10 

10 

0.78 

0.23 

0.57 

-0.34 

5NF24 

C 

0 

17 

17 

0.79 

0.15 

0.56 

-0.45 

5NF24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF25 

* 

-1 

4664 

98 

0.88 

0.02 

0.00 

-0.10 

5NF25 

A 

1 

73 

75 

2.14 

0.10 

0.90 

0.52 

5NF25 

B 

0 

19 

20 

1.10 

0.09 

0.59 

-0.42 

5NF25 

C 

0 

5 

5 

0.84 

0.33 

0.52 

-0.27 

5NF25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF26 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NF26 

A 

1 

58 

62 

2.14 

0.11 

0.80 

0.61 

5NF26 

B 

0 

16 

17 

0.89 

0.15 

0.58 

-0.42 

5NF26 

C 

0 

20 

21 

1.12 

0.11 

0.69 

-0.34 

5NF26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF27 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.05 

5NF27 

A 

1 

52 

52 

1.81 

0.16 

1.06 

0.43 

5NF27 

B 

0 

25 

25 

0.98 

0.12 

0.86 

-0.21 

5NF27 

C 

0 

23 

23 

0.80 

0.17 

0.91 

-0.29 

5NF27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF28 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

5NF28 

A 

1 

84 

87 

2.62 

0.12 

0.90 

0.40 

5NF28 

B 

0 

11 

11 

1.36 

0.32 

1.04 

-0.33 

5NF28 

C 

0 

2 

2 

0.69 

0.00 

0.26 

-0.22 

5NF28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF29 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

5NF29 

A 

1 

61 

49 

2.04 

0.15 

0.98 

0.43 

5NF29 

B 

0 

51 

41 

1.16 

0.09 

0.87 

-0.35 

5NF29 

C 

0 

12 

10 

1.16 

0.12 

0.76 

-0.14 

5NF29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF31 

* 

-1 

4644 

98 

0.89 

0.02 

0.00 

-0.07 

5NF31 

A 

1 

60 

51 

1.65 

0.16 

1.28 

0.18 

5NF31 

B 

0 

38 

32 

1.26 

0.15 

1.40 

-0.12 

5NF31 

C 

0 

19 

16 

1.23 

0.24 

2.67 

-0.09 

5NF31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF310 

* 

-1 

4653 

98 

0.88 

0.02 

0.00 

-0.12 

5NF310 

A 

1 

71 

66 

2.32 

0.11 

0.90 

0.50 

5NF310 

B 

0 

16 

15 

1.03 

0.24 

0.95 

-0.35 

5NF310 

C 

0 

21 

19 

1.30 

0.19 

0.85 

-0.29 

5NF310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF311 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5NF311 

A 

1 

54 

57 

1.76 

0.15 

1.05 

0.35 

5NF311 

B 

0 

20 

21 

1.19 

0.17 

1.17 

-0.13 

5NF311 

C 

0 

20 

21 

0.87 

0.13 

0.75 

-0.29 

5NF311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF312 

* 

-1 

4659 

98 

0.89 

0.02 

0.00 

-0.06 

5NF312 

A 

1 

39 

38 

1.86 

0.15 

1.01 

0.36 

5NF312 

B 

0 

40 

39 

1.33 

0.12 

1.14 

-0.11 

5NF312 

C 

0 

23 

23 

0.98 

0.13 

0.71 

-0.29 

5NF312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF313 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NF313 

A 

1 

69 

66 

2.10 

0.14 

1.00 

0.41 

5NF313 

B 

0 

20 

19 

0.97 

0.14 

0.69 

-0.34 

5NF313 

C 

0 

15 

14 

1.30 

0.24 

1.12 

-0.17 

5NF313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF314 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

5NF314 

A 

1 

50 

45 

1.68 

0.16 

1.03 

0.40 

5NF314 

B 

0 

25 

22 

1.09 

0.16 

1.16 

-0.07 

5NF314 

C 

0 

37 

33 

0.71 

0.12 

0.79 

-0.36 

5NF314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF315 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

5NF315 

A 

1 

38 

40 

0.98 

0.14 

1.06 

0.24 

5NF315 

B 

0 

33 

35 

0.60 

0.12 

1.04 

-0.15 

5NF315 

C 

0 

24 

25 

0.61 

0.16 

1.13 

-0.10 

5NF315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF316 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.11 

5NF316 

A 

1 

57 

58 

2.48 

0.15 

0.89 

0.55 

5NF316 

B 

0 

24 

24 

1.30 

0.13 

0.79 

-0.33 

5NF316 

C 

0 

18 

18 

1.15 

0.17 

0.69 

-0.34 

5NF316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF317 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.11 

5NF317 

A 

1 

43 

38 

2.25 

0.14 

1.06 

0.34 

5NF317 

B 

0 

37 

33 

1.88 

0.12 

1.18 

-0.01 

5NF317 

C 

0 

32 

29 

1.42 

0.12 

0.74 

-0.35 

5NF317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF318 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

5NF318 

A 

1 

36 

36 

2.06 

0.16 

1.26 

0.26 

5NF318 

B 

0 

18 

18 

1.10 

0.18 

0.62 

-0.31 

5NF318 

C 

0 

45 

45 

1.72 

0.14 

1.26 

-0.01 

5NF318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF319 

* 

-1 

4664 

98 

0.88 

0.02 

0.00 

-0.10 

5NF319 

A 

1 

54 

56 

2.17 

0.12 

1.04 

0.38 

5NF319 

B 

0 

25 

26 

1.45 

0.16 

0.94 

-0.27 

5NF319 

C 

0 

18 

19 

1.53 

0.16 

0.95 

-0.18 

5NF319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF32 

* 

-1 

4556 

96 

0.87 

0.02 

0.00 

-0.10 

5NF32 

A 

1 

111 

54 

1.81 

0.09 

1.08 

0.29 

5NF32 

B 

0 

31 

15 

0.89 

0.12 

0.73 

-0.28 

5NF32 

C 

0 

63 

31 

1.40 

0.13 

1.63 

-0.10 

5NF32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF320 

* 

-1 

4532 

95 

0.85 

0.02 

0.00 

-0.16 

5NF320 

A 

1 

139 

61 

2.21 

0.08 

0.93 

0.46 

5NF320 

B 

0 

52 

23 

1.33 

0.11 

0.96 

-0.28 

5NF320 

C 

0 

38 

17 

1.21 

0.09 

0.70 

-0.29 

5NF320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF33 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NF33 

A 

1 

70 

74 

1.96 

0.10 

0.90 

0.48 

5NF33 

B 

0 

16 

17 

1.16 

0.14 

0.80 

-0.28 

5NF33 

C 

0 

8 

9 

0.63 

0.15 

0.44 

-0.37 

5NF33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF34 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

5NF34 

A 

1 

44 

44 

1.88 

0.15 

0.98 

0.44 

5NF34 

B 

0 

22 

22 

0.97 

0.18 

1.15 

-0.20 

5NF34 

C 

0 

33 

33 

0.93 

0.17 

1.74 

-0.29 

5NF34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF35 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

5NF35 

A 

1 

72 

74 

2.78 

0.13 

0.93 

0.50 

5NF35 

B 

0 

18 

19 

1.58 

0.18 

0.75 

-0.35 

5NF35 

C 

0 

7 

7 

1.11 

0.18 

0.39 

-0.32 

5NF35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF36 

* 

-1 

4638 

97 

0.88 

0.02 

0.00 

-0.08 

5NF36 

A 

1 

69 

56 

1.83 

0.14 

1.08 

0.29 

5NF36 

B 

0 

27 

22 

1.16 

0.14 

1.01 

-0.21 

5NF36 

C 

0 

27 

22 

1.31 

0.12 

1.08 

-0.14 

5NF36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF37 

* 

-1 

4644 

98 

0.89 

0.02 

0.00 

-0.07 

5NF37 

A 

1 

76 

65 

1.81 

0.13 

0.88 

0.42 

5NF37 

B 

0 

23 

20 

0.65 

0.16 

0.76 

-0.35 

5NF37 

C 

0 

18 

15 

1.00 

0.20 

1.25 

-0.17 

5NF37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF38 

* 

-1 

4655 

98 

0.88 

0.02 

0.00 

-0.11 

5NF38 

A 

1 

63 

59 

2.30 

0.13 

1.06 

0.42 

5NF38 

B 

0 

15 

14 

1.39 

0.21 

0.90 

-0.20 

5NF38 

C 

0 

28 

26 

1.35 

0.18 

0.92 

-0.31 

5NF38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF39 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

5NF39 

A 

1 

51 

54 

1.77 

0.16 

1.03 

0.34 

5NF39 

B 

0 

16 

17 

1.00 

0.21 

0.95 

-0.20 

5NF39 

C 

0 

27 

29 

1.11 

0.15 

1.09 

-0.21 

5NF39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF41 

* 

-1 

4659 

98 

0.89 

0.02 

0.00 

-0.06 

5NF41 

A 

1 

31 

30 

1.80 

0.18 

1.14 

0.26 

5NF41 

B 

0 

47 

46 

1.33 

0.12 

1.17 

-0.13 

5NF41 

C 

0 

24 

24 

1.24 

0.15 

0.94 

-0.13 

5NF41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF410 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NF410 

A 

1 

85 

82 

1.91 

0.12 

0.99 

0.25 

5NF410 

B 

0 

7 

7 

1.13 

0.41 

1.16 

-0.15 

5NF410 

C 

0 

12 

12 

1.17 

0.31 

1.56 

-0.19 

5NF410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF411 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

5NF411 

A 

1 

47 

42 

1.65 

0.16 

1.05 

0.35 

5NF411 

B 

0 

51 

46 

0.93 

0.12 

1.05 

-0.27 

5NF411 

C 

0 

14 

13 

0.90 

0.29 

1.20 

-0.12 

5NF411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF412 

* 

-1 

4667 

98 

0.91 

0.02 

0.00 

0.02 

5NF412 

A 

1 

59 

63 

0.84 

0.11 

1.09 

0.16 

5NF412 

B 

0 

21 

22 

0.66 

0.15 

1.25 

-0.05 

5NF412 

C 

0 

14 

15 

0.46 

0.19 

1.05 

-0.15 

5NF412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF413 

* 

-1 

4536 

95 

0.87 

0.02 

0.00 

-0.09 

5NF413 

A 

1 

110 

49 

1.79 

0.12 

1.23 

0.29 

5NF413 

B 

0 

43 

19 

1.19 

0.13 

1.30 

-0.12 

5NF413 

C 

0 

72 

32 

1.15 

0.11 

1.21 

-0.20 

5NF413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF414 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.11 

5NF414 

A 

1 

44 

44 

2.40 

0.20 

1.26 

0.35 

5NF414 

B 

0 

31 

31 

1.56 

0.15 

0.97 

-0.24 

5NF414 

C 

0 

24 

24 

1.66 

0.17 

1.10 

-0.15 

5NF414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF415 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.11 

5NF415 

A 

1 

28 

25 

2.02 

0.19 

1.54 

0.09 

5NF415 

B 

0 

51 

46 

2.00 

0.10 

1.25 

0.12 

5NF415 

C 

0 

33 

29 

1.61 

0.14 

0.92 

-0.21 

5NF415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF42 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

5NF42 

A 

1 

45 

45 

1.80 

0.16 

1.64 

0.07 

5NF42 

B 

0 

20 

20 

1.64 

0.19 

1.18 

-0.05 

5NF42 

C 

0 

34 

34 

1.70 

0.15 

1.29 

-0.03 

5NF42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF43 

* 

-1 

4665 

98 

0.88 

0.02 

0.00 

-0.10 

5NF43 

A 

1 

53 

55 

2.08 

0.13 

1.14 

0.28 

5NF43 

B 

0 

31 

32 

1.61 

0.14 

1.09 

-0.19 

5NF43 

C 

0 

12 

13 

1.49 

0.20 

0.90 

-0.15 

5NF43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF44 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NF44 

A 

1 

41 

44 

1.81 

0.16 

1.45 

0.10 

5NF44 

B 

0 

33 

35 

1.81 

0.15 

1.49 

0.08 

5NF44 

C 

0 

20 

21 

1.34 

0.14 

0.80 

-0.22 

5NF44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF45 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

5NF45 

A 

1 

45 

45 

1.78 

0.18 

1.14 

0.36 

5NF45 

B 

0 

35 

35 

1.01 

0.15 

1.04 

-0.25 

5NF45 

C 

0 

19 

19 

1.03 

0.14 

0.88 

-0.15 

5NF45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF46 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

5NF46 

A 

1 

63 

65 

2.91 

0.13 

0.84 

0.56 

5NF46 

B 

0 

23 

24 

1.65 

0.17 

0.73 

-0.38 

5NF46 

C 

0 

11 

11 

1.36 

0.19 

0.49 

-0.33 

5NF46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF47 

* 

-1 

4638 

97 

0.88 

0.02 

0.00 

-0.08 

5NF47 

A 

1 

61 

50 

2.08 

0.14 

0.87 

0.50 

5NF47 

B 

0 

39 

32 

0.93 

0.08 

0.65 

-0.43 

5NF47 

C 

0 

23 

19 

1.31 

0.11 

0.95 

-0.12 

5NF47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF48 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

5NF48 

A 

1 

66 

57 

1.93 

0.14 

0.87 

0.47 

5NF48 

B 

0 

23 

20 

0.82 

0.12 

0.72 

-0.29 

5NF48 

C 

0 

27 

23 

0.90 

0.16 

0.90 

-0.28 

5NF48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF49 

* 

-1 

4655 

98 

0.88 

0.02 

0.00 

-0.11 

5NF49 

A 

1 

69 

65 

2.34 

0.12 

0.87 

0.53 

5NF49 

B 

0 

20 

19 

1.16 

0.20 

0.78 

-0.34 

5NF49 

C 

0 

17 

16 

1.11 

0.19 

0.71 

-0.33 

5NF49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF51 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

5NF51 

A 

1 

28 

30 

1.68 

0.27 

1.61 

0.15 

5NF51 

B 

0 

49 

53 

1.52 

0.12 

1.33 

0.07 

5NF51 

C 

0 

16 

17 

0.84 

0.15 

0.58 

-0.27 

5NF51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF510 

* 

-1 

4659 

98 

0.89 

0.02 

0.00 

-0.06 

5NF510 

A 

1 

37 

36 

1.68 

0.18 

1.30 

0.20 

5NF510 

B 

0 

46 

45 

1.43 

0.10 

1.16 

-0.02 

5NF510 

C 

0 

19 

19 

1.04 

0.18 

0.83 

-0.22 

5NF510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF511 

* 

-1 

4535 

95 

0.86 

0.02 

0.00 

-0.15 

5NF511 

A 

1 

194 

86 

1.97 

0.06 

0.92 

0.44 

5NF511 

B 

0 

18 

8 

0.91 

0.13 

0.64 

-0.28 

5NF511 

C 

0 

14 

6 

0.67 

0.20 

0.55 

-0.32 

5NF511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF512 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NF512 

A 

1 

90 

87 

1.97 

0.12 

0.88 

0.44 

5NF512 

B 

0 

8 

8 

0.54 

0.15 

0.47 

-0.31 

5NF512 

C 

0 

6 

6 

0.44 

0.21 

0.43 

-0.29 

5NF512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF513 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

5NF513 

A 

1 

48 

43 

1.34 

0.15 

1.38 

0.09 

5NF513 

B 

0 

31 

28 

0.98 

0.14 

1.08 

-0.15 

5NF513 

C 

0 

33 

29 

1.31 

0.20 

1.94 

0.05 

5NF513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF514 

* 

-1 

4667 

98 

0.91 

0.02 

0.00 

0.02 

5NF514 

A 

1 

63 

67 

0.83 

0.10 

1.06 

0.16 

5NF514 

B 

0 

13 

14 

0.85 

0.24 

2.32 

0.06 

5NF514 

C 

0 

18 

19 

0.35 

0.16 

0.91 

-0.24 

5NF514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF515 

* 

-1 

4663 

98 

0.88 

0.02 

0.00 

-0.11 

5NF515 

A 

1 

48 

49 

2.52 

0.18 

1.01 

0.49 

5NF515 

B 

0 

36 

37 

1.39 

0.12 

0.78 

-0.38 

5NF515 

C 

0 

14 

14 

1.50 

0.23 

0.95 

-0.17 

5NF515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF516 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.11 

5NF516 

A 

1 

29 

26 

2.48 

0.18 

0.98 

0.42 

5NF516 

B 

0 

13 

12 

1.17 

0.22 

0.59 

-0.31 

5NF516 

C 

0 

70 

63 

1.78 

0.08 

0.95 

-0.17 

5NF516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF517 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

5NF517 

A 

1 

64 

65 

1.97 

0.11 

1.09 

0.33 

5NF517 

B 

0 

20 

20 

1.46 

0.23 

1.37 

-0.14 

5NF517 

C 

0 

15 

15 

1.09 

0.17 

0.74 

-0.28 

5NF517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF518 

* 

-1 

4665 

98 

0.88 

0.02 

0.00 

-0.10 

5NF518 

A 

1 

70 

73 

2.04 

0.10 

0.96 

0.34 

5NF518 

B 

0 

18 

19 

1.45 

0.26 

1.61 

-0.22 

5NF518 

C 

0 

8 

8 

1.15 

0.20 

0.65 

-0.24 

5NF518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF519 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NF519 

A 

1 

75 

80 

1.79 

0.10 

1.06 

0.18 

5NF519 

B 

0 

13 

14 

1.56 

0.27 

1.77 

-0.07 

5NF519 

C 

0 

6 

6 

1.04 

0.23 

0.74 

-0.20 

5NF519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF52 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

5NF52 

A 

1 

52 

53 

1.67 

0.14 

1.03 

0.30 

5NF52 

B 

0 

29 

29 

1.14 

0.21 

1.73 

-0.14 

5NF52 

C 

0 

18 

18 

0.84 

0.18 

0.90 

-0.23 

5NF52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF520 

* 

-1 

4536 

95 

0.85 

0.02 

0.00 

-0.18 

5NF520 

A 

1 

68 

30 

2.66 

0.17 

1.32 

0.40 

5NF520 

B 

0 

132 

59 

1.75 

0.07 

1.02 

-0.22 

5NF520 

C 

0 

25 

11 

1.19 

0.16 

0.58 

-0.24 

5NF520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF53 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

5NF53 

A 

1 

63 

65 

2.73 

0.14 

1.05 

0.34 

5NF53 

B 

0 

20 

21 

2.18 

0.22 

1.52 

-0.11 

5NF53 

C 

0 

14 

14 

1.49 

0.28 

0.78 

-0.34 

5NF53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF54 

* 

-1 

4639 

97 

0.88 

0.02 

0.00 

-0.08 

5NF54 

A 

1 

31 

25 

2.17 

0.26 

1.17 

0.34 

5NF54 

B 

0 

67 

55 

1.40 

0.09 

0.97 

-0.19 

5NF54 

C 

0 

24 

20 

1.28 

0.16 

0.91 

-0.14 

5NF54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF55 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

5NF55 

A 

1 

28 

24 

1.73 

0.33 

2.07 

0.13 

5NF55 

B 

0 

77 

66 

1.48 

0.09 

1.25 

0.02 

5NF55 

C 

0 

11 

9 

0.69 

0.19 

0.50 

-0.23 

5NF55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF56 

* 

-1 

4656 

98 

0.88 

0.02 

0.00 

-0.12 

5NF56 

A 

1 

52 

50 

2.44 

0.14 

0.98 

0.47 

5NF56 

B 

0 

35 

33 

1.55 

0.16 

1.04 

-0.25 

5NF56 

C 

0 

18 

17 

1.20 

0.19 

0.63 

-0.31 

5NF56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF57 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

5NF57 

A 

1 

49 

53 

1.82 

0.16 

1.03 

0.38 

5NF57 

B 

0 

22 

24 

1.04 

0.14 

0.90 

-0.22 

5NF57 

C 

0 

22 

24 

1.04 

0.16 

0.97 

-0.22 

5NF57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF58 

* 

-1 

4659 

98 

0.89 

0.02 

0.00 

-0.06 

5NF58 

A 

1 

44 

43 

1.67 

0.15 

1.20 

0.22 

5NF58 

B 

0 

41 

40 

1.38 

0.12 

1.20 

-0.07 

5NF58 

C 

0 

17 

17 

1.06 

0.19 

0.93 

-0.20 

5NF58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF59 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.10 

5NF59 

A 

1 

58 

56 

2.26 

0.15 

0.95 

0.49 

5NF59 

B 

0 

21 

20 

1.32 

0.16 

0.92 

-0.20 

5NF59 

C 

0 

25 

24 

0.99 

0.15 

0.70 

-0.38 

5NF59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF61 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

5NF61 

A 

1 

65 

58 

1.43 

0.14 

1.20 

0.23 

5NF61 

B 

0 

31 

28 

1.15 

0.14 

1.36 

-0.05 

5NF61 

C 

0 

16 

14 

0.57 

0.20 

0.81 

-0.26 

5NF61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF610 

* 

-1 

4667 

98 

0.91 

0.02 

0.00 

0.02 

5NF610 

A 

1 

45 

48 

1.08 

0.13 

1.01 

0.41 

5NF610 

B 

0 

29 

31 

0.55 

0.08 

0.91 

-0.16 

5NF610 

C 

0 

20 

21 

0.26 

0.12 

0.71 

-0.32 

5NF610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF611 

* 

-1 

4663 

98 

0.88 

0.02 

0.00 

-0.11 

5NF611 

A 

1 

56 

57 

2.44 

0.16 

0.95 

0.49 

5NF611 

B 

0 

19 

19 

1.34 

0.18 

0.81 

-0.27 

5NF611 

C 

0 

23 

23 

1.30 

0.13 

0.71 

-0.32 

5NF611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF612 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.11 

5NF612 

A 

1 

27 

24 

2.12 

0.19 

1.37 

0.15 

5NF612 

B 

0 

55 

49 

1.81 

0.11 

1.07 

-0.09 

5NF612 

C 

0 

30 

27 

1.83 

0.15 

1.12 

-0.05 

5NF612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF613 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

5NF613 

A 

1 

23 

23 

1.69 

0.22 

2.05 

-0.02 

5NF613 

B 

0 

34 

34 

1.73 

0.15 

1.10 

-0.01 

5NF613 

C 

0 

42 

42 

1.76 

0.15 

1.22 

0.03 

5NF613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF614 

* 

-1 

4666 

98 

0.88 

0.02 

0.00 

-0.10 

5NF614 

A 

1 

30 

32 

2.00 

0.19 

1.53 

0.11 

5NF614 

B 

0 

16 

17 

1.71 

0.21 

1.06 

-0.08 

5NF614 

C 

0 

49 

52 

1.82 

0.12 

1.17 

-0.04 

5NF614 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF615 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NF615 

A 

1 

42 

45 

1.84 

0.16 

1.35 

0.13 

5NF615 

B 

0 

27 

29 

1.64 

0.15 

1.22 

-0.05 

5NF615 

C 

0 

25 

27 

1.57 

0.16 

1.13 

-0.10 

5NF615 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF62 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

5NF62 

A 

1 

49 

49 

1.86 

0.16 

1.00 

0.46 

5NF62 

B 

0 

26 

26 

0.90 

0.14 

0.86 

-0.26 

5NF62 

C 

0 

24 

24 

0.86 

0.14 

0.85 

-0.27 

5NF62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF63 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

5NF63 

A 

1 

28 

29 

2.68 

0.22 

1.77 

0.13 

5NF63 

B 

0 

38 

39 

2.73 

0.19 

2.08 

0.20 

5NF63 

C 

0 

31 

32 

1.86 

0.17 

0.74 

-0.34 

5NF63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF64 

* 

-1 

4642 

98 

0.89 

0.02 

0.00 

-0.08 

5NF64 

A 

1 

55 

46 

1.92 

0.16 

1.04 

0.34 

5NF64 

B 

0 

49 

41 

1.36 

0.10 

1.08 

-0.16 

5NF64 

C 

0 

15 

13 

0.85 

0.16 

0.63 

-0.26 

5NF64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF65 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

5NF65 

A 

1 

80 

69 

1.77 

0.13 

0.95 

0.40 

5NF65 

B 

0 

12 

10 

0.56 

0.17 

0.59 

-0.28 

5NF65 

C 

0 

24 

21 

0.93 

0.14 

0.94 

-0.25 

5NF65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF66 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.12 

5NF66 

A 

1 

51 

49 

2.35 

0.15 

1.15 

0.37 

5NF66 

B 

0 

37 

36 

1.53 

0.16 

1.03 

-0.28 

5NF66 

C 

0 

16 

15 

1.57 

0.21 

0.93 

-0.14 

5NF66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF67 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

5NF67 

A 

1 

53 

57 

1.80 

0.15 

0.97 

0.39 

5NF67 

B 

0 

22 

24 

1.13 

0.17 

1.09 

-0.17 

5NF67 

C 

0 

18 

19 

0.82 

0.15 

0.74 

-0.30 

5NF67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF68 

* 

-1 

4660 

98 

0.89 

0.02 

0.00 

-0.06 

5NF68 

A 

1 

43 

43 

1.84 

0.15 

1.04 

0.38 

5NF68 

B 

0 

34 

34 

1.01 

0.12 

0.80 

-0.36 

5NF68 

C 

0 

24 

24 

1.39 

0.14 

1.24 

-0.04 

5NF68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF69 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.10 

5NF69 

A 

1 

64 

63 

2.13 

0.15 

1.06 

0.39 

5NF69 

B 

0 

10 

10 

0.42 

0.11 

0.32 

-0.39 

5NF69 

C 

0 

28 

27 

1.49 

0.13 

1.12 

-0.16 

5NF69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF71 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

5NF71 

A 

1 

45 

40 

1.81 

0.16 

0.94 

0.46 

5NF71 

B 

0 

26 

23 

0.76 

0.15 

0.79 

-0.25 

5NF71 

C 

0 

41 

37 

0.88 

0.13 

0.96 

-0.25 

5NF71 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF710 

* 

-1 

4667 

98 

0.91 

0.02 

0.00 

0.02 

5NF710 

A 

1 

36 

38 

1.01 

0.14 

1.07 

0.27 

5NF710 

B 

0 

22 

23 

0.50 

0.12 

0.88 

-0.17 

5NF710 

C 

0 

36 

38 

0.62 

0.12 

1.13 

-0.13 

5NF710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF711 

* 

-1 

4663 

98 

0.88 

0.02 

0.00 

-0.11 

5NF711 

A 

1 

45 

46 

2.65 

0.17 

0.86 

0.56 

5NF711 

B 

0 

24 

24 

1.41 

0.14 

0.74 

-0.28 

5NF711 

C 

0 

29 

30 

1.35 

0.15 

0.77 

-0.35 

5NF711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF712 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.11 

5NF712 

A 

1 

40 

36 

1.90 

0.14 

1.46 

0.01 

5NF712 

B 

0 

49 

44 

2.07 

0.11 

1.48 

0.19 

5NF712 

C 

0 

23 

21 

1.48 

0.15 

0.78 

-0.25 

5NF712 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF713 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

5NF713 

A 

1 

51 

52 

2.22 

0.12 

0.91 

0.53 

5NF713 

B 

0 

23 

23 

1.33 

0.16 

0.88 

-0.23 

5NF713 

C 

0 

25 

25 

1.11 

0.17 

0.76 

-0.38 

5NF713 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF714 

* 

-1 

4666 

98 

0.88 

0.02 

0.00 

-0.10 

5NF714 

A 

1 

55 

58 

2.09 

0.13 

1.17 

0.29 

5NF714 

B 

0 

18 

19 

1.59 

0.19 

1.09 

-0.14 

5NF714 

C 

0 

22 

23 

1.52 

0.16 

1.02 

-0.21 

5NF714 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF715 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.09 

5NF715 

A 

1 

47 

50 

1.87 

0.13 

1.18 

0.18 

5NF715 

B 

0 

21 

22 

1.22 

0.15 

0.78 

-0.30 

5NF715 

C 

0 

26 

28 

1.82 

0.19 

1.86 

0.08 

5NF715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF72 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

5NF72 

A 

1 

49 

49 

1.90 

0.16 

0.95 

0.50 

5NF72 

B 

0 

27 

27 

0.90 

0.16 

0.99 

-0.27 

5NF72 

C 

0 

23 

23 

0.76 

0.11 

0.66 

-0.31 

5NF72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF73 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

5NF73 

A 

1 

57 

59 

2.88 

0.15 

1.03 

0.46 

5NF73 

B 

0 

21 

22 

1.74 

0.16 

0.76 

-0.32 

5NF73 

C 

0 

19 

20 

1.87 

0.23 

0.99 

-0.24 

5NF73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF74 

* 

-1 

4642 

98 

0.89 

0.02 

0.00 

-0.08 

5NF74 

A 

1 

60 

50 

1.93 

0.15 

1.04 

0.38 

5NF74 

B 

0 

41 

34 

1.29 

0.10 

1.09 

-0.19 

5NF74 

C 

0 

18 

15 

0.89 

0.12 

0.62 

-0.27 

5NF74 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF75 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

5NF75 

A 

1 

78 

67 

1.72 

0.14 

1.04 

0.32 

5NF75 

B 

0 

16 

14 

0.99 

0.16 

0.97 

-0.17 

5NF75 

C 

0 

22 

19 

0.93 

0.18 

1.06 

-0.23 

5NF75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF76 

* 

-1 

4657 

98 

0.88 

0.02 

0.00 

-0.12 

5NF76 

A 

1 

83 

80 

2.18 

0.11 

0.88 

0.44 

5NF76 

B 

0 

9 

9 

1.17 

0.36 

1.05 

-0.22 

5NF76 

C 

0 

12 

12 

0.85 

0.28 

0.71 

-0.36 

5NF76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF77 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

5NF77 

A 

1 

55 

59 

1.70 

0.15 

1.09 

0.29 

5NF77 

B 

0 

21 

23 

0.95 

0.15 

0.87 

-0.26 

5NF77 

C 

0 

17 

18 

1.28 

0.18 

1.25 

-0.08 

5NF77 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5NF78 

* 

-1 

4660 

98 

0.89 

0.02 

0.00 

-0.06 

5NF78 

A 

1 

21 

21 

1.85 

0.23 

1.37 

0.23 

5NF78 

B 

0 

35 

35 

1.22 

0.11 

0.81 

-0.19 

5NF78 

C 

0 

45 

45 

1.45 

0.14 

1.45 

-0.01 

5NF78 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5NF79 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.10 

5NF79 

A 

1 

66 

65 

2.13 

0.15 

1.02 

0.41 

5NF79 

B 

0 

18 

18 

1.47 

0.17 

1.10 

-0.13 

5NF79 

C 

0 

18 

18 

0.83 

0.17 

0.64 

-0.38 

5NF79 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A11 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

50A11 

A 

1 

85 

76 

1.51 

0.10 

0.84 

0.49 

50A11 

B 

0 

20 

18 

0.41 

0.18 

0.82 

-0.37 

50A11 

C 

0 

7 

6 

0.14 

0.23 

0.50 

-0.27 

50A11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5OA110 

* 

-1 

4667 

98 

0.91 

0.02 

0.00 

0.02 

5OA110 

A 

1 

63 

67 

0.92 

0.10 

0.98 

0.32 

5OA110 

B 

0 

13 

14 

0.13 

0.16 

0.70 

-0.32 

5OA110 

C 

0 

18 

19 

0.57 

0.14 

1.10 

-0.11 

5OA110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A111 

* 

-1 

4663 

98 

0.88 

0.02 

0.00 

-0.11 

50A111 

A 

1 

26 

27 

2.81 

0.28 

1.26 

0.45 

50A111 

B 

0 

23 

23 

1.28 

0.15 

0.52 

-0.34 

50A111 

C 

0 

49 

50 

1.83 

0.12 

0.99 

-0.11 

50A111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A112 

* 

-1 

4649 

98 

0.88 

0.02 

0.00 

-0.11 

50A112 

A 

1 

71 

63 

2.22 

0.09 

0.84 

0.51 

50A112 

B 

0 

11 

10 

1.15 

0.20 

0.67 

-0.29 

50A112 

C 

0 

30 

27 

1.39 

0.12 

0.82 

-0.36 

50A112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A113 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

50A113 

A 

1 

45 

45 

1.82 

0.15 

1.63 

0.09 

50A113 

B 

0 

21 

21 

1.09 

0.20 

0.80 

-0.35 

50A113 

C 

0 

33 

33 

2.02 

0.14 

1.79 

0.21 

50A113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A114 

* 

-1 

4666 

98 

0.88 

0.02 

0.00 

-0.10 

50A114 

A 

1 

70 

74 

2.08 

0.10 

0.93 

0.41 

50A114 

B 

0 

3 

3 

1.33 

0.52 

0.91 

-0.11 

50A114 

C 

0 

22 

23 

1.23 

0.17 

0.85 

-0.38 

50A114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A115 

* 

-1 

4556 

96 

0.87 

0.02 

0.00 

-0.10 

50A115 

A 

1 

102 

50 

1.99 

0.10 

0.99 

0.46 

50A115 

B 

0 

36 

18 

0.91 

0.11 

0.69 

-0.29 

50A115 

C 

0 

67 

33 

1.19 

0.09 

0.95 

-0.25 

50A115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A116 

* 

-1 

4535 

95 

0.87 

0.02 

0.00 

-0.09 

50A116 

A 

1 

173 

77 

1.67 

0.09 

1.04 

0.34 

50A116 

B 

0 

7 

3 

0.46 

0.29 

0.64 

-0.16 

50A116 

C 

0 

46 

20 

0.84 

0.09 

0.87 

-0.29 

50A116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A117 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.08 

50A117 

A 

1 

51 

55 

2.03 

0.13 

1.01 

0.40 

50A117 

B 

0 

10 

11 

0.73 

0.19 

0.47 

-0.38 

50A117 

C 

0 

32 

34 

1.50 

0.11 

1.04 

-0.17 

50A117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A118 

* 

-1 

4525 

95 

0.86 

0.02 

0.00 

-0.13 

50A118 

A 

1 

208 

88 

1.85 

0.08 

0.92 

0.38 

50A118 

B 

0 

9 

4 

0.77 

0.27 

0.87 

-0.16 

50A118 

C 

0 

19 

8 

0.41 

0.13 

0.49 

-0.34 

50A118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A119 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

50A119 

A 

1 

49 

49 

1.97 

0.15 

0.80 

0.57 

50A119 

B 

0 

23 

23 

0.70 

0.13 

0.65 

-0.34 

50A119 

C 

0 

27 

27 

0.82 

0.15 

0.90 

-0.31 

50A119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A12 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

50A12 

A 

1 

76 

78 

2.72 

0.13 

0.91 

0.46 

50A12 

B 

0 

15 

15 

1.64 

0.19 

0.80 

-0.29 

50A12 

C 

0 

6 

6 

0.86 

0.26 

0.34 

-0.35 

50A12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5OA120 

* 

-1 

4643 

98 

0.89 

0.02 

0.00 

-0.08 

5OA120 

A 

1 

55 

47 

1.76 

0.17 

1.25 

0.19 

5OA120 

B 

0 

17 

14 

1.46 

0.20 

1.41 

-0.04 

5OA120 

C 

0 

46 

39 

1.34 

0.11 

1.14 

-0.17 

5OA120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A121 

* 

-1 

4534 

95 

0.85 

0.02 

0.00 

-0.16 

50A121 

A 

1 

75 

33 

2.38 

0.14 

1.18 

0.37 

50A121 

B 

0 

74 

33 

1.71 

0.10 

1.08 

-0.11 

50A121 

C 

0 

78 

34 

1.50 

0.08 

0.79 

-0.26 

50A121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A122 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

50A122 

A 

1 

49 

42 

1.99 

0.19 

1.05 

0.40 

50A122 

B 

0 

46 

40 

1.13 

0.11 

0.96 

-0.24 

50A122 

C 

0 

21 

18 

0.99 

0.19 

0.93 

-0.20 

50A122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A123 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

50A123 

A 

1 

43 

42 

2.63 

0.15 

0.83 

0.55 

50A123 

B 

0 

25 

24 

1.22 

0.18 

0.66 

-0.37 

50A123 

C 

0 

35 

34 

1.56 

0.15 

0.91 

-0.24 

50A123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A124 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

50A124 

A 

1 

37 

40 

1.88 

0.21 

1.17 

0.34 

50A124 

B 

0 

21 

23 

1.33 

0.14 

1.07 

-0.07 

50A124 

C 

0 

35 

38 

1.07 

0.13 

0.91 

-0.29 

50A124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A125 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

50A125 

A 

1 

72 

72 

1.70 

0.11 

0.95 

0.43 

50A125 

B 

0 

12 

12 

0.75 

0.13 

0.63 

-0.30 

50A125 

C 

0 

16 

16 

0.93 

0.13 

0.78 

-0.26 

50A125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A126 

* 

-1 

4660 

98 

0.88 

0.02 

0.00 

-0.10 

50A126 

A 

1 

52 

51 

2.19 

0.17 

1.08 

0.38 

50A126 

B 

0 

28 

28 

1.45 

0.21 

1.84 

-0.17 

50A126 

C 

0 

21 

21 

1.16 

0.15 

0.72 

-0.27 

50A126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A127 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

50A127 

A 

1 

84 

75 

1.54 

0.10 

0.83 

0.53 

50A127 

B 

0 

13 

12 

0.42 

0.21 

0.74 

-0.29 

50A127 

C 

0 

15 

13 

0.17 

0.12 

0.48 

-0.41 

50A127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A128 

* 

-1 

4667 

98 

0.91 

0.02 

0.00 

0.02 

50A128 

A 

1 

53 

56 

1.03 

0.11 

0.93 

0.43 

50A128 

B 

0 

26 

28 

0.47 

0.10 

0.91 

-0.22 

50A128 

C 

0 

15 

16 

0.19 

0.15 

0.74 

-0.31 

50A128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A129 

* 

-1 

4663 

98 

0.88 

0.02 

0.00 

-0.11 

50A129 

A 

1 

72 

73 

2.32 

0.13 

0.89 

0.53 

50A129 

B 

0 

15 

15 

0.82 

0.08 

0.44 

-0.43 

50A129 

C 

0 

11 

11 

1.14 

0.12 

0.63 

-0.26 

50A129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A13 

* 

-1 

4650 

98 

0.88 

0.02 

0.00 

-0.11 

50A13 

A 

1 

37 

33 

2.16 

0.17 

1.39 

0.24 

50A13 

B 

0 

52 

47 

1.81 

0.09 

1.06 

-0.09 

50A13 

C 

0 

22 

20 

1.59 

0.14 

0.84 

-0.17 

50A13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5OA130 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

5OA130 

A 

1 

42 

42 

2.08 

0.14 

1.12 

0.32 

5OA130 

B 

0 

40 

40 

1.70 

0.13 

1.25 

-0.03 

5OA130 

C 

0 

17 

17 

0.95 

0.24 

0.75 

-0.37 

5OA130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A131 

* 

-1 

4666 

98 

0.88 

0.02 

0.00 

-0.10 

50A131 

A 

1 

54 

57 

2.15 

0.12 

1.04 

0.37 

50A131 

B 

0 

33 

35 

1.53 

0.14 

1.01 

-0.27 

50A131 

C 

0 

8 

8 

1.27 

0.18 

0.66 

-0.20 

50A131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A132 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.08 

50A132 

A 

1 

62 

67 

2.05 

0.10 

0.85 

0.54 

50A132 

B 

0 

26 

28 

1.02 

0.12 

0.68 

-0.48 

50A132 

C 

0 

5 

5 

1.06 

0.31 

0.72 

-0.17 

50A132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A133 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

50A133 

A 

1 

60 

61 

1.74 

0.14 

0.96 

0.44 

50A133 

B 

0 

16 

16 

0.74 

0.20 

0.83 

-0.26 

50A133 

C 

0 

23 

23 

0.81 

0.13 

0.85 

-0.29 

50A133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A134 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

50A134 

A 

1 

56 

58 

2.87 

0.15 

1.04 

0.44 

50A134 

B 

0 

7 

7 

1.53 

0.30 

0.59 

-0.22 

50A134 

C 

0 

34 

35 

1.90 

0.15 

0.93 

-0.34 

50A134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A14 

* 

-1 

4643 

98 

0.89 

0.02 

0.00 

-0.08 

50A14 

A 

1 

33 

28 

1.88 

0.24 

1.31 

0.20 

50A14 

B 

0 

60 

51 

1.45 

0.10 

1.11 

-0.10 

50A14 

C 

0 

25 

21 

1.35 

0.20 

1.66 

-0.10 

50A14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A15 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

50A15 

A 

1 

68 

59 

1.82 

0.14 

0.99 

0.37 

50A15 

B 

0 

25 

22 

1.19 

0.20 

1.54 

-0.13 

50A15 

C 

0 

23 

20 

0.74 

0.11 

0.65 

-0.32 

50A15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A16 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

50A16 

A 

1 

34 

33 

2.02 

0.22 

1.92 

0.06 

50A16 

B 

0 

25 

24 

1.19 

0.18 

0.59 

-0.39 

50A16 

C 

0 

44 

43 

2.27 

0.12 

1.63 

0.28 

50A16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A17 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

50A17 

A 

1 

75 

81 

1.60 

0.12 

0.96 

0.29 

50A17 

B 

0 

11 

12 

1.03 

0.33 

1.72 

-0.15 

50A17 

C 

0 

7 

8 

0.54 

0.19 

0.59 

-0.25 

50A17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A18 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

50A18 

A 

1 

27 

27 

1.80 

0.20 

1.19 

0.23 

50A18 

B 

0 

63 

63 

1.35 

0.10 

1.08 

-0.17 

50A18 

C 

0 

10 

10 

1.25 

0.27 

1.00 

-0.08 

50A18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A19 

* 

-1 

4661 

98 

0.88 

0.02 

0.00 

-0.10 

50A19 

A 

1 

51 

51 

2.25 

0.18 

1.18 

0.41 

50A19 

B 

0 

19 

19 

1.23 

0.16 

0.78 

-0.23 

50A19 

C 

0 

30 

30 

1.33 

0.15 

1.04 

-0.25 

50A19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A21 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

50A21 

A 

1 

63 

56 

1.45 

0.14 

1.19 

0.25 

50A21 

B 

0 

26 

23 

0.95 

0.17 

1.25 

-0.15 

50A21 

C 

0 

23 

21 

0.93 

0.20 

1.34 

-0.15 

50A21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5OA210 

* 

-1 

4667 

98 

0.91 

0.02 

0.00 

0.02 

5OA210 

A 

1 

63 

67 

0.90 

0.10 

1.01 

0.29 

5OA210 

B 

0 

15 

16 

0.29 

0.16 

0.84 

-0.26 

5OA210 

C 

0 

16 

17 

0.54 

0.13 

1.02 

-0.12 

5OA210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A211 

* 

-1 

4664 

98 

0.88 

0.02 

0.00 

-0.12 

50A211 

A 

1 

39 

40 

2.55 

0.20 

1.06 

0.42 

50A211 

B 

0 

41 

42 

1.76 

0.15 

1.21 

-0.16 

50A211 

C 

0 

17 

18 

1.17 

0.13 

0.50 

-0.33 

50A211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A212 

* 

-1 

4650 

98 

0.88 

0.02 

0.00 

-0.11 

50A212 

A 

1 

87 

78 

2.09 

0.08 

0.89 

0.48 

50A212 

B 

0 

8 

7 

1.26 

0.22 

0.77 

-0.21 

50A212 

C 

0 

16 

14 

1.05 

0.14 

0.60 

-0.41 

50A212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A213 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

50A213 

A 

1 

46 

46 

1.88 

0.13 

1.33 

0.14 

50A213 

B 

0 

31 

31 

1.88 

0.16 

1.59 

0.10 

50A213 

C 

0 

22 

22 

1.23 

0.21 

0.92 

-0.28 

50A213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A214 

* 

-1 

4666 

98 

0.88 

0.02 

0.00 

-0.10 

50A214 

A 

1 

39 

41 

2.26 

0.15 

1.08 

0.36 

50A214 

B 

0 

24 

25 

1.75 

0.15 

1.05 

-0.07 

50A214 

C 

0 

32 

34 

1.46 

0.14 

0.87 

-0.31 

50A214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A215 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.08 

50A215 

A 

1 

74 

80 

1.86 

0.10 

0.99 

0.34 

50A215 

B 

0 

10 

11 

0.93 

0.14 

0.63 

-0.30 

50A215 

C 

0 

9 

10 

1.32 

0.29 

1.23 

-0.14 

50A215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A216 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

50A216 

A 

1 

67 

68 

1.64 

0.14 

1.00 

0.38 

50A216 

B 

0 

16 

16 

0.76 

0.17 

0.81 

-0.25 

50A216 

C 

0 

16 

16 

0.80 

0.17 

0.90 

-0.23 

50A216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A217 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

50A217 

A 

1 

69 

71 

2.71 

0.13 

0.96 

0.37 

50A217 

B 

0 

14 

14 

1.66 

0.26 

0.93 

-0.27 

50A217 

C 

0 

14 

14 

1.86 

0.32 

1.43 

-0.20 

50A217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A218 

* 

-1 

4536 

95 

0.85 

0.02 

0.00 

-0.18 

50A218 

A 

1 

164 

73 

2.27 

0.09 

0.92 

0.44 

50A218 

B 

0 

20 

9 

0.96 

0.13 

0.57 

-0.27 

50A218 

C 

0 

41 

18 

1.22 

0.11 

0.80 

-0.30 

50A218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A219 

* 

-1 

4643 

98 

0.89 

0.02 

0.00 

-0.08 

50A219 

A 

1 

54 

46 

2.00 

0.17 

1.06 

0.41 

50A219 

B 

0 

35 

30 

1.29 

0.09 

0.94 

-0.17 

50A219 

C 

0 

29 

25 

1.03 

0.11 

0.74 

-0.29 

50A219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A22 

* 

-1 

4556 

96 

0.88 

0.02 

0.00 

-0.09 

50A22 

A 

1 

98 

48 

1.90 

0.10 

0.95 

0.43 

50A22 

B 

0 

65 

32 

1.00 

0.07 

0.81 

-0.32 

50A22 

C 

0 

42 

20 

1.14 

0.13 

1.06 

-0.17 

50A22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5OA220 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

5OA220 

A 

1 

81 

70 

1.71 

0.13 

1.04 

0.33 

5OA220 

B 

0 

15 

13 

0.89 

0.17 

0.88 

-0.20 

5OA220 

C 

0 

20 

17 

0.91 

0.16 

0.98 

-0.23 

5OA220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A221 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

50A221 

A 

1 

66 

64 

2.27 

0.13 

0.99 

0.42 

50A221 

B 

0 

18 

17 

1.39 

0.20 

0.92 

-0.23 

50A221 

C 

0 

19 

18 

1.24 

0.23 

0.89 

-0.30 

50A221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A222 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

50A222 

A 

1 

69 

74 

1.72 

0.13 

0.93 

0.43 

50A222 

B 

0 

15 

16 

0.81 

0.10 

0.72 

-0.28 

50A222 

C 

0 

9 

10 

0.51 

0.20 

0.57 

-0.30 

50A222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A223 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

50A223 

A 

1 

46 

46 

1.88 

0.14 

0.97 

0.44 

50A223 

B 

0 

22 

22 

1.31 

0.14 

1.05 

-0.09 

50A223 

C 

0 

32 

32 

0.96 

0.11 

0.73 

-0.39 

50A223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A224 

* 

-1 

4661 

98 

0.88 

0.02 

0.00 

-0.10 

50A224 

A 

1 

58 

58 

2.12 

0.15 

1.04 

0.35 

50A224 

B 

0 

26 

26 

1.39 

0.22 

1.90 

-0.20 

50A224 

C 

0 

16 

16 

1.17 

0.21 

0.85 

-0.23 

50A224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A225 

* 

-1 

4650 

98 

0.89 

0.02 

0.00 

-0.04 

50A225 

A 

1 

80 

72 

1.50 

0.11 

0.89 

0.43 

50A225 

B 

0 

17 

15 

0.86 

0.20 

1.24 

-0.15 

50A225 

C 

0 

14 

13 

0.09 

0.17 

0.50 

-0.42 

50A225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A226 

* 

-1 

4667 

98 

0.91 

0.02 

0.00 

0.02 

50A226 

A 

1 

65 

69 

0.91 

0.10 

0.97 

0.33 

50A226 

B 

0 

17 

18 

0.16 

0.13 

0.71 

-0.35 

50A226 

C 

0 

12 

13 

0.65 

0.19 

1.22 

-0.05 

50A226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A227 

* 

-1 

4664 

98 

0.88 

0.02 

0.00 

-0.12 

50A227 

A 

1 

58 

60 

2.26 

0.15 

1.05 

0.31 

50A227 

B 

0 

24 

25 

1.79 

0.23 

1.88 

-0.09 

50A227 

C 

0 

15 

15 

1.13 

0.13 

0.56 

-0.32 

50A227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A228 

* 

-1 

4650 

98 

0.88 

0.02 

0.00 

-0.11 

50A228 

A 

1 

74 

67 

2.10 

0.09 

0.93 

0.36 

50A228 

B 

0 

11 

10 

1.02 

0.19 

0.57 

-0.34 

50A228 

C 

0 

26 

23 

1.64 

0.16 

1.22 

-0.16 

50A228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A229 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

50A229 

A 

1 

71 

72 

2.03 

0.10 

0.95 

0.50 

50A229 

B 

0 

13 

13 

1.00 

0.22 

0.75 

-0.30 

50A229 

C 

0 

15 

15 

0.96 

0.18 

0.70 

-0.34 

50A229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A23 

* 

-1 

4666 

98 

0.88 

0.02 

0.00 

-0.10 

50A23 

A 

1 

66 

69 

1.92 

0.12 

1.28 

0.10 

50A23 

B 

0 

9 

9 

1.53 

0.21 

1.04 

-0.12 

50A23 

C 

0 

20 

21 

1.82 

0.16 

1.44 

-0.02 

50A23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5OA230 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.08 

5OA230 

A 

1 

72 

77 

1.95 

0.10 

0.89 

0.49 

5OA230 

B 

0 

9 

10 

1.01 

0.21 

0.78 

-0.25 

5OA230 

C 

0 

12 

13 

0.81 

0.15 

0.57 

-0.39 

5OA230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A231 

* 

-1 

4537 

95 

0.86 

0.02 

0.00 

-0.15 

50A231 

A 

1 

199 

89 

1.92 

0.06 

0.92 

0.39 

50A231 

B 

0 

19 

8 

0.88 

0.16 

0.67 

-0.31 

50A231 

C 

0 

6 

3 

0.65 

0.43 

0.64 

-0.21 

50A231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A232 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

50A232 

A 

1 

38 

38 

1.73 

0.19 

1.21 

0.27 

50A232 

B 

0 

22 

22 

0.96 

0.21 

1.10 

-0.20 

50A232 

C 

0 

39 

39 

1.24 

0.15 

1.31 

-0.10 

50A232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A233 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

50A233 

A 

1 

58 

60 

2.89 

0.15 

1.02 

0.48 

50A233 

B 

0 

28 

29 

1.70 

0.14 

0.72 

-0.41 

50A233 

C 

0 

11 

11 

1.92 

0.31 

1.03 

-0.16 

50A233 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A24 

* 

-1 

4643 

98 

0.89 

0.02 

0.00 

-0.08 

50A24 

A 

1 

85 

72 

1.78 

0.12 

0.95 

0.37 

50A24 

B 

0 

14 

12 

0.83 

0.21 

0.81 

-0.26 

50A24 

C 

0 

19 

16 

1.05 

0.09 

0.79 

-0.22 

50A24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A25 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

50A25 

A 

1 

63 

54 

1.94 

0.15 

0.96 

0.46 

50A25 

B 

0 

29 

25 

0.94 

0.13 

0.84 

-0.27 

50A25 

C 

0 

24 

21 

0.87 

0.13 

0.78 

-0.27 

50A25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A26 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

50A26 

A 

1 

44 

43 

2.46 

0.16 

1.06 

0.43 

50A26 

B 

0 

46 

45 

1.72 

0.14 

1.20 

-0.17 

50A26 

C 

0 

13 

13 

0.84 

0.16 

0.37 

-0.38 

50A26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A27 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

50A27 

A 

1 

33 

35 

1.42 

0.23 

1.93 

-0.02 

50A27 

B 

0 

38 

41 

1.80 

0.13 

1.96 

0.28 

50A27 

C 

0 

22 

24 

0.90 

0.10 

0.62 

-0.30 

50A27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A28 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

50A28 

A 

1 

56 

56 

1.76 

0.13 

1.04 

0.37 

50A28 

B 

0 

24 

24 

1.17 

0.12 

0.97 

-0.18 

50A28 

C 

0 

20 

20 

0.99 

0.14 

0.81 

-0.27 

50A28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A29 

* 

-1 

4661 

98 

0.88 

0.02 

0.00 

-0.10 

50A29 

A 

1 

59 

59 

2.11 

0.15 

1.00 

0.34 

50A29 

B 

0 

32 

32 

1.37 

0.19 

1.48 

-0.24 

50A29 

C 

0 

9 

9 

1.09 

0.28 

0.77 

-0.19 

50A29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A31 

* 

-1 

4556 

96 

0.90 

0.02 

0.00 

-0.02 

50A31 

A 

1 

110 

54 

1.31 

0.10 

1.02 

0.35 

50A31 

B 

0 

65 

32 

0.67 

0.09 

1.01 

-0.24 

50A31 

C 

0 

30 

15 

0.60 

0.15 

0.96 

-0.17 

50A31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5OA310 

* 

-1 

4539 

95 

0.87 

0.02 

0.00 

-0.10 

5OA310 

A 

1 

86 

39 

2.03 

0.14 

1.21 

0.39 

5OA310 

B 

0 

127 

57 

1.15 

0.08 

0.99 

-0.35 

5OA310 

C 

0 

9 

4 

1.04 

0.21 

0.72 

-0.08 

5OA310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A311 

* 

-1 

4556 

96 

0.90 

0.02 

0.00 

-0.02 

50A311 

A 

1 

89 

43 

1.37 

0.11 

1.09 

0.34 

50A311 

B 

0 

73 

36 

0.83 

0.09 

1.14 

-0.13 

50A311 

C 

0 

43 

21 

0.54 

0.10 

0.78 

-0.25 

50A311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A312 

* 

-1 

4664 

98 

0.88 

0.02 

0.00 

-0.12 

50A312 

A 

1 

53 

55 

2.26 

0.17 

1.25 

0.28 

50A312 

B 

0 

40 

41 

1.69 

0.14 

1.26 

-0.21 

50A312 

C 

0 

4 

4 

1.01 

0.19 

0.45 

-0.18 

50A312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A313 

* 

-1 

4651 

98 

0.88 

0.02 

0.00 

-0.11 

50A313 

A 

1 

42 

38 

2.00 

0.15 

1.46 

0.11 

50A313 

B 

0 

29 

26 

1.70 

0.14 

1.08 

-0.14 

50A313 

C 

0 

39 

35 

1.90 

0.12 

1.23 

0.01 

50A313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A314 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

50A314 

A 

1 

53 

54 

2.11 

0.12 

1.00 

0.43 

50A314 

B 

0 

19 

19 

1.38 

0.17 

0.93 

-0.18 

50A314 

C 

0 

27 

27 

1.23 

0.19 

1.00 

-0.32 

50A314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A315 

* 

-1 

4666 

98 

0.88 

0.02 

0.00 

-0.10 

50A315 

A 

1 

41 

43 

2.25 

0.14 

1.07 

0.38 

50A315 

B 

0 

25 

26 

1.35 

0.14 

0.76 

-0.33 

50A315 

C 

0 

29 

31 

1.74 

0.16 

1.17 

-0.09 

50A315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A316 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.08 

50A316 

A 

1 

36 

39 

2.23 

0.15 

0.92 

0.46 

50A316 

B 

0 

28 

30 

1.42 

0.13 

0.88 

-0.21 

50A316 

C 

0 

29 

31 

1.35 

0.14 

0.85 

-0.27 

50A316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A317 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

50A317 

A 

1 

52 

53 

1.81 

0.15 

0.98 

0.45 

50A317 

B 

0 

22 

22 

1.08 

0.20 

1.48 

-0.14 

50A317 

C 

0 

25 

25 

0.67 

0.11 

0.64 

-0.38 

50A317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A318 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

50A318 

A 

1 

70 

72 

2.81 

0.13 

0.86 

0.52 

50A318 

B 

0 

8 

8 

1.21 

0.15 

0.41 

-0.32 

50A318 

C 

0 

19 

20 

1.57 

0.21 

0.77 

-0.37 

50A318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A319 

* 

-1 

4643 

98 

0.89 

0.02 

0.00 

-0.08 

50A319 

A 

1 

85 

72 

1.80 

0.11 

0.93 

0.40 

50A319 

B 

0 

22 

19 

0.86 

0.13 

0.74 

-0.32 

50A319 

C 

0 

11 

9 

0.98 

0.12 

0.75 

-0.18 

50A319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A32 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

50A32 

A 

1 

66 

57 

1.65 

0.15 

1.19 

0.19 

50 A3 2 

B 

0 

34 

29 

1.46 

0.14 

1.54 

-0.01 

50 A3 2 

C 

0 

16 

14 

0.73 

0.21 

0.84 

-0.26 

50A32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5OA320 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

5OA320 

A 

1 

60 

58 

2.24 

0.14 

1.19 

0.34 

5OA320 

B 

0 

19 

18 

1.23 

0.22 

0.82 

-0.30 

5OA320 

C 

0 

24 

23 

1.70 

0.17 

1.17 

-0.11 

5OA320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A321 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

50A321 

A 

1 

46 

49 

1.87 

0.18 

1.06 

0.40 

50A321 

B 

0 

27 

29 

1.06 

0.13 

0.87 

-0.25 

50A321 

C 

0 

20 

22 

1.02 

0.13 

0.83 

-0.22 

50A321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A322 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

50A322 

A 

1 

59 

59 

1.84 

0.11 

0.86 

0.51 

50A322 

B 

0 

15 

15 

0.81 

0.12 

0.63 

-0.31 

50A322 

C 

0 

26 

26 

0.99 

0.13 

0.83 

-0.32 

50A322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A323 

* 

-1 

4661 

98 

0.88 

0.02 

0.00 

-0.10 

50A323 

A 

1 

76 

76 

1.95 

0.13 

1.06 

0.26 

50A323 

B 

0 

7 

7 

1.13 

0.41 

1.27 

-0.15 

50A323 

C 

0 

17 

17 

1.29 

0.24 

1.52 

-0.19 

50A323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50A324 

* 

-1 

4650 

98 

0.89 

0.02 

0.00 

-0.04 

50A324 

A 

1 

74 

67 

1.58 

0.12 

0.88 

0.49 

50A324 

B 

0 

10 

9 

0.41 

0.24 

0.69 

-0.25 

50A324 

C 

0 

27 

24 

0.55 

0.13 

0.74 

-0.37 

50A324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A325 

* 

-1 

4667 

98 

0.91 

0.02 

0.00 

0.02 

50A325 

A 

1 

51 

54 

1.02 

0.11 

0.93 

0.39 

50A325 

B 

0 

35 

37 

0.43 

0.10 

0.91 

-0.31 

50A325 

C 

0 

8 

9 

0.32 

0.25 

0.84 

-0.17 

50A325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A326 

* 

-1 

4664 

98 

0.88 

0.02 

0.00 

-0.12 

50A326 

A 

1 

45 

46 

2.48 

0.18 

1.03 

0.42 

50A326 

B 

0 

31 

32 

1.43 

0.14 

0.84 

-0.33 

50A326 

C 

0 

21 

22 

1.69 

0.23 

1.29 

-0.13 

50A326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A327 

* 

-1 

4539 

95 

0.86 

0.02 

0.00 

-0.15 

50A327 

A 

1 

119 

54 

2.11 

0.08 

1.06 

0.36 

50A327 

B 

0 

33 

15 

1.20 

0.14 

0.77 

-0.27 

50A327 

C 

0 

70 

32 

1.55 

0.11 

1.26 

-0.18 

50A327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A328 

* 

-1 

4651 

98 

0.88 

0.02 

0.00 

-0.11 

50A328 

A 

1 

22 

20 

2.34 

0.23 

1.23 

0.27 

50A328 

B 

0 

72 

65 

1.86 

0.09 

1.05 

-0.04 

50A328 

C 

0 

16 

15 

1.39 

0.14 

0.59 

-0.24 

50A328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A329 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

50A329 

A 

1 

42 

42 

2.18 

0.14 

1.01 

0.40 

50A329 

B 

0 

26 

26 

1.56 

0.18 

1.13 

-0.11 

50A329 

C 

0 

31 

31 

1.27 

0.15 

0.81 

-0.33 

50A329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50 A3 3 

* 

-1 

4666 

98 

0.88 

0.02 

0.00 

-0.10 

50 A3 3 

A 

1 

45 

47 

2.11 

0.13 

1.10 

0.26 

50 A3 3 

B 

0 

31 

33 

1.77 

0.17 

1.56 

-0.07 

50 A3 3 

C 

0 

19 

20 

1.43 

0.19 

0.90 

-0.24 

50 A3 3 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5OA330 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.08 

5OA330 

A 

1 

32 

34 

2.08 

0.20 

1.35 

0.30 

5OA330 

B 

0 

45 

48 

1.59 

0.10 

1.00 

-0.12 

5OA330 

C 

0 

16 

17 

1.29 

0.18 

0.78 

-0.21 

5OA330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A331 

* 

-1 

4662 

98 

0.89 

0.02 

0.00 

-0.05 

50A331 

A 

1 

29 

29 

1.74 

0.23 

1.37 

0.23 

50A331 

B 

0 

52 

53 

1.35 

0.14 

1.38 

-0.01 

50A331 

C 

0 

18 

18 

0.79 

0.16 

0.60 

-0.26 

50A331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A332 

* 

-1 

4664 

98 

0.87 

0.02 

0.00 

-0.16 

50A332 

A 

1 

31 

32 

2.58 

0.26 

2.39 

0.09 

50A332 

B 

0 

21 

22 

1.79 

0.20 

0.67 

-0.29 

50A332 

C 

0 

45 

46 

2.64 

0.14 

1.53 

0.16 

50A332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50A333 

* 

-1 

4643 

98 

0.89 

0.02 

0.00 

-0.08 

50A333 

A 

1 

29 

25 

1.86 

0.26 

1.37 

0.17 

50A333 

B 

0 

77 

65 

1.49 

0.10 

1.33 

-0.08 

50A333 

C 

0 

12 

10 

1.18 

0.27 

1.07 

-0.12 

50A333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50 A3 4 

* 

-1 

4524 

95 

0.86 

0.02 

0.00 

-0.14 

50 A3 4 

A 

1 

219 

92 

1.78 

0.07 

0.96 

0.27 

50 A3 4 

B 

0 

12 

5 

0.76 

0.24 

0.85 

-0.19 

50A34 

C 

0 

6 

3 

0.33 

0.29 

0.51 

-0.19 

50A34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

50 A3 5 

* 

-1 

4645 

98 

0.89 

0.02 

0.00 

-0.07 

50 A3 5 

A 

1 

25 

22 

1.87 

0.34 

1.76 

0.19 

50 A3 5 

B 

0 

56 

48 

1.55 

0.11 

1.33 

0.07 

50 A3 5 

C 

0 

35 

30 

1.05 

0.15 

0.87 

-0.24 

50 A3 5 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50 A3 6 

* 

-1 

4658 

98 

0.88 

0.02 

0.00 

-0.11 

50 A3 6 

A 

1 

44 

43 

2.41 

0.16 

1.03 

0.38 

50 A3 6 

B 

0 

30 

29 

1.66 

0.21 

1.23 

-0.16 

50 A3 6 

C 

0 

29 

28 

1.48 

0.16 

0.82 

-0.26 

50 A3 6 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50 A3 7 

* 

-1 

4668 

98 

0.89 

0.02 

0.00 

-0.06 

50 A3 7 

A 

1 

45 

48 

1.81 

0.18 

1.13 

0.33 

50 A3 7 

B 

0 

28 

30 

1.01 

0.12 

0.83 

-0.28 

50 A3 7 

C 

0 

20 

22 

1.27 

0.17 

1.17 

-0.09 

50 A3 7 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50 A3 8 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

50 A3 8 

A 

1 

53 

53 

1.69 

0.13 

1.11 

0.28 

50 A3 8 

B 

0 

18 

18 

1.18 

0.16 

0.99 

-0.15 

50 A3 8 

C 

0 

29 

29 

1.22 

0.15 

1.12 

-0.18 

50 A3 8 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

50 A3 9 

* 

-1 

4661 

98 

0.88 

0.02 

0.00 

-0.10 

50 A3 9 

A 

1 

42 

42 

2.31 

0.21 

1.18 

0.39 

50 A3 9 

B 

0 

23 

23 

1.04 

0.17 

0.64 

-0.35 

50 A3 9 

C 

0 

35 

35 

1.64 

0.14 

1.13 

-0.09 

50 A3 9 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



